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ABSTRACT 


MDA  (multiple  discriminant  analysis)  has  been  found  useful  in  pre¬ 
dicting  the  probability  of  operationally  critical  airfield  ceiling  and 
visibility  conditions.  One  part  of  the  discriminant  procedure  requires 
at  the  outset  a  rather  lengthy  computation  by  machine  to  estimate  these 
probabilities.  While  the  operational  use  of  the  method  takes  much  less 
effort,  the  time  needed  initially  on  a  large  scale  computer  may  be  in¬ 
ordinate  when  many  elements,  time  periods,  and  geographical  locations 
are  beir^  considered.  This  technical  report  discusses  a  prediction 
technique,  REEP  (regression  estimation  of  event  probabilities),  which 
resulted  from  attempts  to  make  MDA  more  efficient.  Comparative  studies 
between  REEP  and  MDA  are  included  as  well  as  other  experimentations 
performed  using  the  REEP  procedure.  Recommendations  for  future  work 
on  the  technique  are  also  given. 
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1 .0  INTRODUCTION 


The  objective  of  this  task  was  to  develop,  in  the  MDA  (Multiple 
discriminant  analysis)  framework,  a  method  which  would  produce  medium 
range  ceiling  and  visibility  forecasts  efficiently.  The  original  plan 
was  to  investigate  the  use  of  a  multivariate  statistical  procedure 
called  canonical  correlation — discriminant  analysis  being  a  special 
case  of  canonical  correlation.  By  incorporating  a  feature  which 
screened  predictors  in  canonical  correlation,  it  was  expected  that 
more  than  one  predictand  could  be  processed  simultaneously  with  a 
resulting  saving  in  computer  time. 

Work  on  screening  canonical  correlation  was  proceeding  satis¬ 
factorily  until  it  was  found  that  a  technique  subsequently  called 
REEP  (regression  estimation  of  event  probabilities)  possessed  even 
more  desirable  computational  features.  It  was  later  discovered  that 
the  REEP  technique  had  appeared  in  the  literature  in  1955,  Lund  QQ , 
(see  also  Lund  [V])*  In  addition,  work  related  to  this  approach  has 
been  published  by  Cox  £3,  4]]  and  by  Warner  QQ* 

This  technical  report  consists  of  1)  a  discussion  of  the  REEP 
technique ,  2)  the  results  of  a  comparative  study  between  REEP  and 
MDA,  3)  the  results  from  a  series  of  experiments  investigating  various 
aspects  of  the  REEP  procedure,  4)  the  results  from  experiments  per¬ 
formed  to  study  the  effect  of  modifying  the  form  of  the  predictor 
variables  by  means  of  Boolean  expressions,  and  5)  discussion  and 
recommendations  for  future  study.; 
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2.0  THE  REE?  PROCEDURE 


Consider  the  problem  of  estimating  the  probability  distribution 
over  a  set  of  G  mutually  exclusive  and  exhaustive  groups  where  the 
groups  are  defined  for  a  specific  predictand.  The  statistical  tech¬ 
nique  of  discriminant  analysis  may  be  used  to  estimate  probability 
distributions  of  this  type  QQ.  The  suggested  approach  for  estimating 
the  group  probabilities,  when  the  underlying  density  functions  are 
unknown,  is  that  of  Fix  and  Hodges.  This  approach  requires  the  com¬ 
putation  of  "distances”  in  the  discriminant  space  between  a  new 
observation  and  each  observation  of  the  developmental  sample.  The 
set  of  k  close  neighbors  is  then  used  to  estimate  the  group  proba¬ 
bilities. 

The  REEP  procedure  may  be  thought  of  as  an  alterative  to  the 
Fix-Hodgea  method  employed  in  MDA.  Or,  more  appropriately,  it  can 
be  viewed  as  a  self-contained  statistical  prediction  method.  The 
followii^  is  a  description  of  the  REEP  procedure : 

Perform  a  series  of  multiple  regressions  on  G  zero-one 
dependent  variables,  T^,...,T^,,  where  each  dependent  variable 
is  associated  with  one  of  G  predictand  groups.  The  independent 
variables,  are  taken  to  be  the  same  throughout  each 

of  the  G  regressions.  The  object  of  this  series  of  regressions 
is  to  obtain  the  least  squares  estimate  of  the  A’ a  in  the  following 
equations : 


E(Y1  ji)  -  Z  A,  „Xf 


E(I,  X)  -  X  *, .X 


28  a 


e(tJx)  -  SArI 


Gs  s 


where  XQ  2  1 


All  of  the  conditional  distributions,  f(Y  X),  g*1,...,G,  are 

8 

Bernoulli  distributions  (zero- one)  and  on  a  single  trial  the  expec¬ 
tation  is  equal  to  the  probability  that  Y  ■  1  „  Thus  the  regression 

© 

functions  give  least  squares  estimates  of  the  group  probabilities, 

g  (g^l . G). 

These  estimates  possess  certain  desirable  and  certain  undesirable 
properties: 

Desirable 

G  * 

1)  The  estimates  add  to  unity,  i.e,,  /-I  P  *  1. 

g“1  S 

2)  The  estimates  essentially  minimize  the  Brier-Alien  P  score, 

N  G  A  . 

i.e..  2  2(*i, -V  • 

i=1  g-1  16 

Undesirable 

1 )  The  estimates  are  not  bounded  by  0  and  1  • 
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An  intuitively  reasonable  approach  and  the  one  used  to  remedy  this  un¬ 
desirable  property  is  to  renormalize  the  estimates  byr  a)  setting  all 
negatives  equal  to  zero,  b)  setting  all  estimates  greater  than  one 
equal  to  one,  and  c)  divided  each  by  the  resulting  overall  sum. 


1.0  REEP  HtSDICTOR  SELECTION 

A  predictor  selection  procedure  has  been  incorporated  into  the 

REEP  procedure  similar  to  that  used  in  regression  and  MDA  £6j,  namely? 

(1 

Out  of  a  set  of  P  possible  predictors  X  '  is  selected  such 

that  in  the  developmental  sample  it  contributes  most  significantly  with 

regard  to  one  of  the  G  predictands.  That  is,  out  of  the  G  possible 

(1 ) 

F  distribution  statistics  the  predictor  X  has  one  of  these  com¬ 
puted  statistics  larger  than  any  one  of  the  G  computed  for  the  re¬ 
maining  P-1  predictors. 

(2) 

In  a  similar  manner,  a  second  predictor  X  is  selected  from 

the  P-I  remaining  predictors  when  considered  in  conjunction  with 

X^\  Selection  continues  until  r  predictors  X^  \  X^2\  X^ 

( r+1 ) 

have  been  chosenj  r  is  determined  such  that  Xv  7  is  not  satis¬ 
factorily  significant.  The  significance  criterion  has  been  designed 
similar  to  that  used  in  screenir^  regression  and  MDA  (see  page  13 » 
reference  [V]).  Namely,  compare  the  G  possible  computed  F  sta¬ 
tistics,  at  any  of  the  r  selection  stages,  with  a  critical  value 

of  F.  ,  where  the  size  oc  of  the  test  is  — p* — - s=.  The 

20  [P  ~  (S’1)-! 

value  S  denotes  the  selection  stage  number  or  equivalently  the 
number  of  predictors  thus  far  selected.  Tests  must  still  be  performed 
to  confirm  its  applicability,  ha/ ever. 
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4.0  EXPERIMENTATION 

A  number  of  experiments  were  performed  to  test  certain  aspects  of 
the  REEP  procedure.  The  complete  list  of  experiment  titles  is  given 
below. 


Experiment  1  - 

Experiment  1A  - 

Experiment  2  - 
Experiment  3  - 

Experiment  4  - 

Experiment  5  - 
Experiment  6  - 

Experiment  7  - 

Experiment  8  - 


Title 


Comparison  Between  MDA  and  REEP  (Atlantic 
City  Airport) . 

Comparison  Between  MDA  and  REEP  (Offutt 
AFB,  Nebraska). 

Standard  Dunsnies  versus  Cumulative  Dummies 

Nullifying  the  Effect  of  High  Ceilings  in 
Predictor  Selection. 

Ceiling  Prediction  Using  Persistence  with 
One  and  Two  Hour  Lagged  Persistence. 

Multiple  Predictands  Processed  Simultaneously. 

Effect  of  Restricting  Selection  to  Predictors 
with  Certain  Minimum  Occurrence  Frequencies. 

Single -Station  Predictors:  Raw  Dummies  and 
Boolean  Conbinations. 

Combination  of  Selected  Predictors  from  Net¬ 
work  and  Single -Station  Boolean. 


Page 

7 

25 

44 

69 

78 

89 

96 

106 

129 
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EXPERIMENT  1 .  Comparison  Between  MDA  and  REEP  (Atlantic  City  Airport) 


Purpose 

To  compare  the  results  of  short  range  ceiling  and  visibility  pre¬ 
dictions  using  the  MDA  technique  and  the  REEP  technique.  In  the  event 
REEP  compares  favorably  with  MDA  it  might,  because  of  its  computational 
efficiency,  be  used  in  place  of  MDA  for  forecasting  ceiling  and  visibilities. 
Procedure 

A  test  of  the  REEP  technique  was  made  by  comparing  independent  sample 
predictions  of  ceiling  and  visibility  using  REEP  and  MDA.  Each  technique 
was  allowed  to  select  predictors  and  generate  probability  forecasts  in¬ 
dependently.  Predictions  were  made  for  two  stations,  Atlantic  City 
Airport,  New  Jersey  and  Offutt  AFB,  Nebraska.  (See  Experiment  1A  for 
Offutt.) 

Predictands 

The  five  operationally  significant  categories  of  ceiling  and  visi¬ 
bility  at  Atlantic  City  Airport,  New  Jersey  for  the  forecast  intervals 
of  three  and  seven  hours  define  the  four  predictands  for  which  the  tech¬ 
niques  are  compared  (see  Table  1-1).  The  specifications  for  each  pre- 
dictand  are  given  in  Table  1-2. 

Predictors 

Seven  meteorological  elements  at  1 3  predictor  stations  (see  Figure 
1-1)  plus  the  time  of  day  (TOD)  and  day  of  year  (DOT)  variables  were 
transformed  into  dummy  (zero-one)  variables  (see  Tables  1-3  and  1-4). 

This  set  of  423  dummy  predictors  was  used  as  possible  predictors  for 
all  four  predictands. 
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n-4.- 


WaWOMlg^NW 

Standard  hourly  airways  surface  observations  covering  the  10  year 
period,  1  January  1949  to  31  December  1958,  furnished  the  data  for  this 
study.  There  are  87,672  hour 3  in  the  10  years  from  1949  through  1958. 
This  is  too  many  to  use  efficiently;  besides  not  all  hours  are  needed 
because  of  the  serial  correlation  present  in  meteorological  variables. 
The  amount  of  data  was  reduced  by  a  three-stage  process: 

(a)  Any  variable  not  observed  for  a  substantial  portion  of 
the  87,672  hours  was  eliminated.  A  variable  was  also 
eliminated  if  the  frequency  distribution  of  its  error 
vector  exhibited  a  bias  with  regard  to  hour  of  day  or 

;  onth  of  year. 

(b)  Those  hours  were  eliminated  for  which  any  one  of  the 
variables  was  missing  or  failed  to  pass  a  gross-error 
check. 

(c)  A  random  selection  of  the  remaining  hours  was  made  to 
select  10,000  cases. 

Results 

The  four  sets  of  predictors  selected  by  MDA  and  REEP  respectively 
are  given  in  Tables  1-5a  to  1-5d  as  well  as  the  REEP  regression  equation 
coefficients  for  each  group  of  the  predictand.  Contingency  tables  (see  . 
Tables  1-6a  to  1-6d)  shew  the  forecast- versus-observed  frequencies  for 
persistence,  MDA,  and  REEP.  The  number  of  correct  forecasts  (hits)  and 
the  Brier  and  Allen  P  scores  as  well  as  the  individual  group  contri- 
but ions  to  the  overall  P  score  are  given  below  each  contingency  table. 
The  number  of  hits  and  the  overall  P  scores  are  summarized  in  Table  1-7 
by  predictand. 

Conclusions 

See  Experiment  1A. 
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m  i  ^  4  4 

ittoxe  i - i 

Definition  of  Predictand  Groups  for  Atlantic  City  Municipal  Airport 


Group 

Number  Ceiling  Intervals 


1 

0  ft 

< 

Ceiling  <  200  ft 

2 

200  ft 

< 

Ceiling  <  500  ft 

3 

500  ft 

< 

Ceiling  <  1000  ft 

4 

1000  ft 

< 

Ceiling  <  3000  ft 

5 

3000  ft 

< 

Ceiling 

Group 

Number 

Visibility  Intervals 

1 

0  mi 

< 

Visibility  <  1/2  mi 

2 

1/2  mi 

< 

Visibility  <  1  mi 

3 

1  mi 

< 

Visibility  <  2  mi 

4 

2  mi 

< 

Visibility  <  3  mi 

3 

3  mi 

< 

Visibility 
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Ttble  1-2 


Specification  of  Predictands 
Atlantic  City  Municipal  Airport 


Predictand 


1 

2 

3 

_ L. 

Predictand  variable 

GIG 

CIG 

VIS 

VIS 

Forecast  interval— hours  (H) 

3 

7 

3 

7 

Humber  of  Groups  (G) 

5 

5 

5 

5 

Observations  in  Group  1  (nj ) 

100 

135 

153 

167 

Observations  in  Group  2  (n^) 

281 

272 

125 

130 

Observations  in  Group  3  (n^) 

385 

420 

200 

230 

Observations  in  Group  4  (n^) 

660 

619 

286 

283 

Observations  in  Group  5  (n^) 

6530 

6510 

7192 

7146 

Total  dependent  sanple  size  (N) 

7956 

7956 

7956 

7956 

Humber  of  independent  observations 
in  the  dependent  sample  (n) 

2652 

2652 

2652 

2652 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

2044 

Humber  of  available  predictors  (P) 

423 

423 

423 

423 
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Table  1-3 


IJu*ber  of  Poe  sibls  Predictors  for  the 
3~  and  7- hr  Ceiling  and  Visibility  at  ACT 


Station 


ACT 

MEL 

PHL  SBT 

MDT 

DCA 

CRF 

PSB 

SWF 

RXC 

IDL 

DSM 

Total 

TOO 

5 

- 

- 

- 

- 

mm 

M 

- 

- 

- 

- 

- 

5 

DOT 

1 

- 

- 

- 

e» 

- 

- 

- 

- 

«* 

- 

- 

1 

CIG 

15 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

- 

70 

VIS 

15 

J 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

- 

70 

WIO 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

65 

RLH 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

39 

TCA 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

26 

WEA 

12 

12 

12 

12 

12 

12 

- 

12 

12 

12 

12 

12 

12 

144 

SCL 

3 

aw 

- 

- 

- 

- 

Total 

1  S 

12 


T'r.VT  a  1 

•  — 


Specifications  ana  Limits  of  ine  Zero- On©  (DuSrajr;  Variables 


» - J-V1-- 


Liaits  of  Each  Category 


Meteorological  Number  of 
Element _  Dummies 


TOD  5  1. 

2, 

3. 

4. 

5. 

DOT  1  1. 

WND  51. 

2. 

3. 

4. 

5. 

RW  3  1. 

2. 

3. 


Time  of  Day: 

From  0130  EST  to  1330  EST 
From  0130  EST  to  0730  EST 
From  0730  EST  to  1330  EST 
From  1330  EST  to  1930  EST 
From  1930  EST  to  0130  EST 

Day  of  Tear: 

From  1 51  (31  May)  to  300  (27  Oct) 
Wind: 

Calm  to  3  Knots,  any  direction 
From  23°  to  67°,  3  Knots  < 

From  68°  to  202°,  3  Xnots  < 

From  203°  to  2^7°,  3  Knots  < 

From  248°  to  22°,  3  Knots  < 

Relative  Humidity: 

From  75  per  cent  to  85  per  cent 
From  86  per  cent  to  93  per  cent 
From  94  per  cent  to  100  per  cent 


TCA 


CIO 


Total  Cloud  Amount: 

2  1.  From  5/10  to  9/10  (incl.) 

2.  More  than  9/10 


Ceiling  Height,  ft: 


1.  0 

< 

CIG 

<  200 

2.  200 

< 

CIG 

<  500 

3.  500 

< 

CIG 

<  1000 

4.  1000 

< 

CIG 

<  3000 

5.  3000 

< 

CIG 

13 

Speed 

Speed 

Speed 

Speed 


Table  1-4  -  Continued 


Meteorological 

Element 


CIG 


Number  of 
Dummies 


10 


VIS 


VIS 


10 


Limits  of  Each  Category 

Ceiling  Height*,  ft: 


(1) 

CIG 

* 

100 

(2) 

CIG 

- 

200 

(3) 

CIG 

- 

400 

(4) 

CIG 

- 

500 

(5) 

CIG 

- 

900 

(6) 

1500 

< 

CIG 

< 

2000 

(7) 

2500 

< 

CIG 

< 

3000 

(8) 

3000 

< 

CIG 

< 

5000 

(9) 

5000 

< 

CIG 

<  10,000 

(10) 

CIG 

- 1 

Unlimil 

Visibility. 

ad: 

1. 

0 

< 

VIS 

< 

1/2 

2. 

1/2 

< 

VIS 

< 

1 

3. 

1 

< 

VIS 

< 

2 

4* 

2 

< 

VIS 

< 

3 

5. 

3 

< 

VIS 

Visibility*. 

mi 

• 

• 

(D 

1/4 

< 

VIS 

< 

1/2 

(2) 

1/2 

< 

VIS 

< 

3/4 

(3) 

3/4 

< 

VIS 

< 

1 

(4) 

1 

< 

VIS 

< 

1-1/2 

(5) 

1-1/2 

< 

VIS 

< 

2 

(6) 

2 

< 

VIS 

< 

3 

(7) 

3 

< 

VIS 

< 

4 

(8) 

4 

< 

VIS 

< 

5 

(9) 

5 

< 

VIS 

< 

6 

do) 

15 

< 

VIS 

♦Parentheses  are  used  here  to  help  distinguish  the  two  forms  of  ceiling 
and  eligibility  dummies. 


Table  1-4  -  Continued 


Meteorological  Number  of 

Element  Dummies  Limits  of  Each  Category 


WEA 


SCL 


Weather  Element: 

Teletype  Code: 

1 .  No  Weather 

2.  Rain 

R-,.R,  R+ 

3 •  Rain  Showers 

RW-,  RW,  RW- 

4*  Drizzle  or 

L->  L,  L+ 

Freezing  Drizzle 

ZL-,  ZL,  Z W- 

5*  Snow 

S-,  S,  S+ 

Snow  Pellets 

SP-,  SP,  SPt 

Snow  Grains 

SG-,  SG,  SGH* 

Ice  Crystals 

IC-,  IC,  10+ 

6.  Snow  Showers 

SW-,  SW,  SW+ 

Snow  Squalls 

SQ-,  SQ,  SQ+ 

7.  Tornado 

Tornado 

Thunderstorm 

T,  T4- 

Squalls 

Q-»  Q,  Q+ 

Hail 

A~,  A,  A+ 

Hail  Pellets 

AP-,  AP,  AP+ 

8,  Freezing  Rain 

ZR-,  ZR,  ZR+ 

Sleet 

E-,  E,  E+ 

Sleet  Showers 

EW-,  EW,  EW+ 

9.  Fog,  Ice  Fog 

F,  IF 

10#  Ground  Fog 

GF 

1 1 .  Blowing  Snow 

BS 

Blowing  Sand 

BN 

Blowing  Dust 

BD 

12*  Smoke,  Haze,  Dust 

K,  H,  D 

Sky  Condition.  Lower: 

1 .  Sky  obscured 

X 

2.  Thin  broken  clouds 

-<B> 

Thin  overcast 

-  © 

3 •  Scattered  clouds 

0 

Dark  scattered  clouds 

+  0 

15 


Selected  Predictors  end  REEP  Equations 
Atlantic  City  3-hr  Ceiling 


2  3* 


•H  tJ  H 
T)  «>  W 
0)  -P 
C.  O  _ 

(L  II  c 

HO 
0)  H 
tO  -P 


v  un 

OJ 

& 

<*> 

cv 

.076 

cp 

O 

O' 

o 

.072 

O' 

g  I 

Q  Q 

3 

o 

q 

.075 

o 

.026 

01 1* 

CP 

CM 

o 

sO 

CP 

cm 

» 

i 

1 

1 

i 

t 

i 

i 

i 

a 

i 

1 

to 

CM 

O' 

cp 

un 

<*N 

s 

CM 

<v 

£* 

q 

§ 

R 

o 

on 

8 

CM 

ip 

o 

O' 

o 

i 

p~ 

CM 

o 

O' 

8 

00 

V" 

o 

NO 

s? 

P 

V* 

1 

O' 

3 

r 

1 

• 

1 

t 

1 

1 

1 

1 

i 

1 

i 

025 

ir\ 

(M 

O 

p- 

NO 

o 

CM 

8 

00 

to 

tr\ 

o 

sO 

8 

-# 

q 

o 

*" 

o 

§ 

8 

o 

P 

o 

'O 

CM 

o 

O' 

o 

p- 

8 

CM 

(M 
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Selected  Predictor 8  and  REEP  Equations 
Atlantic  City  3-hr  Visibility 
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Selected  Predictors  and  REEP  Equations 
Atlantic  City  7-hr  Visibility 
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Table  1 -6a 


Contingency  Tables  Showing  Predict ed-Versus-Actual  Groups 
for  Persistence,  MDA,  and  KEEP 

3-hr  Ceiling  (Independent  Sample) 


PERSISTENCE 


MDA 


KEEP 


Actual 


Group 

1 

2 

. . 3  .... 

.  4  __ 

? 

Total 

1 

21 

£ 

4 

0 

5 

38 

2 

13 

33 

25 

10 

9 

90 

3 

2 

14 

50 

21 

21 

108 

4 

1 

a 

21 

6a 

70 

168 

5 

7 

10 

27 

66 

1530 

1640 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  »  1702  P 

*  0.2385 

P 

£ 

0.01 56 

0.0284 

0.0462 

0.0636 

0.0847 

Actual 

Group 

1 

2 

3 

4  _  __ 

5 

Total 

1 

13 

5 

2 

0 

4 

24 

2 

14 

29 

24 

6 

1 

74 

3 

1 

13 

41 

15 

6 

76 

4 

3 

14 

24 

53 

36 

130 

5 

13 

12 

36 

91 

1538 

1740 

Total 

44 

,73 

127 

165 

1635 

2044 

Hits  -  1724  P 

-  0.2135 

P 

0.0161 

0.0279 

0.0424 

0.0601 

0.0669 

£ 

Actual 


Group 

1 

2 

3 

4__ 

5 

Total 

1 

6 

4 

1 

0 

1 

12 

2 

19 

34 

25 

8 

4 

90 

3 

0 

11 

42 

14 

5 

72 

4 

1 

6 

19 

41 

20 

87 

5 

18 

18 

40 

102 

1605 

1783 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  -  1728  P  *■  0.2135 

P  0.0163  0.0277  0.0423  0.0605  0.0666 

£ 
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Table  1-6b 


Contingency  Tables  Showing  Predicted- Versus-Actual  Groups 
for  Persistence,  MDA,  and  REEF 

7-hr  Ceiling  (Independent  Sample) 


PERSISTENCE 


MDA 


KEEP 


Actual 


Group 

1 

2 

3 

_  .  4 

p 

Total 

1 

8 

12 

8 

4 

6 

38 

2 

12 

22 

19 

19 

18 

90 

3 

7 

9 

38 

26 

28 

108 

4 

2 

12 

33 

37 

84 

168 

5 

12 

24 

49 

72 

1483 

1640 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  = 

1588  P 

»  0.2899 

P 

g 

0.0183  0.0342  0.0598 

0.0671 

0.1105 

Actual 

Group 

1 

2 

.....  3  . 

4 

? 

Total 

1 

0 

0 

0 

0 

0 

0 

2 

6 

9 

10 

4 

0 

29 

3 

9 

29 

42 

15 

12 

107 

4 

2 

5 

9 

13 

12 

41 

5 

24 

36 

86 

126 

1595 

1867 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  «* 

1659  P 

=  0.2589 

P 

g 

0.0181 

0.0321  0.0539 

0.0653 

0.0894 

Actual 


Group 

1 

2 

3 

4 

5 

Total 

1 

0 

0 

0 

0 

0 

0 

2 

3 

9 

9 

1 

2 

24 

3 

7 

19 

34 

12 

9 

81 

4 

8 

7 

22 

20 

6 

63 

5 

23 

44 

82 

125 

1602 

1876 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  -  1665  P 

-  0.2600 

P 

g 

0.0180 

0.0323 

0.0540 

0.0666 

0.0891 
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Contingency  Tables  Showing  Predieted-Ver sue -Actual  Groups 
for  Persistence,  MDA,  and  KEEP 

3- hr  Visibility  (Independent  Sample) 


i 


PERSISTENCE 


HDA 


KEEP 


Group 

1 

2 

Actual 

> 

4 

5 

Total 

1 

17 

10 

7 

1 

6 

41 

2 

4 

S 

9 

1 

16 

38 

3 

4 

11 

21 

11 

31 

78 

4 

3 

6 

13 

23 

45 

90 

5 

14 

11 

28 

57 

1687 

1797 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  -  1756  P 

»  0.1910 

P 

g 

0.0170 

0.0200 

0.0334 

0.0413 

0.0793 

Actual 

Group 

1 

2 

.  3  . 

4 

5 

Total 

1 

16 

10 

6 

1 

5 

38 

2 

2 

4 

3 

0 

5 

14 

3 

0 

0 

0 

0 

n 

0 

4 

0 

0 

0 

0 

0 

0 

5 

24 

32 

69 

92 

1775 

1992 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  *=  1795  P 

=  0.1795 

P 

g 

0.0173 

0.0201 

0.0329 

0.0391 

0.0701 

Actual 

Group 

1 

2 

_  3 

4 

5 

Total 

1 

13 

9 

5 

1 

4 

32 

2 

2 

5 

4 

0 

9 

20 

3 

0 

2 

0 

0 

0 

2 

4 

0 

0 

3 

4 

0 

7 

5 

27 

30 

66 

88 

1772 

1983 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  «  1794  P 

-  0.1800 

P 

g 

0.01 69 

0.01 99 

0.0331 

0.0395 

0.0707 
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Table  1  -6d 

Contingency  Tables  Showing  Predict^nd-Versus-Actual  Groups 
for  Persistence,  MDA,  and  REEP 

7-h”  Visibility  (Independent  Sample) 


Group 

1 

2 

Actual 

3  . 

4  __ 

5 

Total 

1 

6 

4 

6 

7 

18 

41 

2 

3 

3 

4 

4 

24 

38 

PERSISTENCE 

3 

4 

8 

17 

9 

40 

78 

4 

7 

2 

15 

11 

55 

90 

5 

23 

21 

48 

68 

1637 

1797 

Total 

43 

38 

90 

99 

1774 

2044 

Hits  =  1 374  P 

“  0.2270 

P 

g 

0.0201 

0.0180 

0.0405 

0.0455 

0.1029 

Actual 

Group 

1 

2 

3 

4.  . 

5 

Total 

1 

0 

0 

0 

0 

0 

0 

2 

0 

0 

0 

0 

0 

0 

MDA 

3 

0 

0 

0 

0 

0 

0 

4 

0 

0 

0 

0 

0 

0 

5 

43 

38 

90 

99 

1774 

2044 

Total 

43 

38 

90 

99 

1774 

2044 

Hits  “  1774  P 

“  0.2120 

P 

g 

0.0191 

0.0178 

0.0391 

0.0448 

0.0912 

Actual 

Group 

1 

2 

3 

4 

5 

Total 

1 

0 

0 

1 

0 

1 

2 

2 

0 

0 

0 

0 

0 

0 

REEP 

3 

0 

0 

0 

0 

0 

0 

4 

0 

0 

0 

0 

0 

0 

5 

43 

38 

89 

99 

1773 

204 2 

Total 

43 

38 

90 

99 

1774 

2044 

Hits  -1773  P 

“  0.2150 

P 

0.0196  0.0178 

0.0394 

0.0446 

0.0936 

g 
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Table  1-7 

Coopariaon  Between  Persistence,  MDA,  and  REEP 
(Independent  Saaple  -  2044  Observations) 


*  vcxxxiik  J  nuur 

Persistence 

1702 

Hits 

MDA 

1724 

REEP 

1728* 

Persistence 

.2385 

P  Score 

MDA 

.2135* 

keep 

.2135* 

Atlantic  City 

,  Ceilin*  7  Hours  in  Advance 

Persistence 

1588 

Hits 

MDA 

1659 

REEP 

1665* 

Persistence 

.2899 

P  Score 

MDA 

.2589* 

REEP 

.2600 

Atlantic  City, 

Visibility  3  Hours  in  Advance 

Persistence 

1756 

Hits 

MDA 

1795* 

REEP 

1794 

Persistence 

.1910 

P  Score 

MDA 

.1795* 

REEP 

.1800 

Atlantic  City. 

Visibility  7  Hours  in  Advance 

Persistence 

1674 

Hits 

MDA 

1774* 

REEP 

1773 

Persistence 

.2270 

P  Score 

MDA 

.2120* 

REEP 

.2150 

Asterisks  are  used  to  denote  superiority. 
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EXPERIMENT  1A.  Comparison  Between  MDA  and  REEP  (Offutt  AFB,  Nebraska) 


The  Purpose  and  the  Procedure  are  the  same  as  those  in  Experiment 
No.  1. 

Predictands 

Visibility  at  Offutt  AFB  was  divided  into  four  and  ceiling  into 
five  operationally  significant  categories  (see  Table  1 A— 1 )  for  the  fol¬ 
lowing  four  predictands:  CIG  +  3  hours,  CIG  +  7  hours,  VIS  +  3  hours, 
and  VIS  +  7  hours.  The  specif ications  of  the  predictands  are  tabulated 
in  Table  1A-2. 

Predictors 

As  in  Experiment  1,  seven  meteorological  elements  at  t-he  1 3  pre¬ 
dictor  stations  constituted  the  Offutt  AFB  network  (see  Figure  1 A-1 ) , 
plus  the  time  of  day  and  day  of  year  variables.  These  were  then  trans¬ 
formed  into  423  duiwny  variables  (see  Tables  1A-3  and  1A-4). 

Data  Sample 

A  data  sample  containing  10,000  observations  was  selected  at 
rand  can  from  the  ten  year  period,  1  January  1949  to  31  December  1958. 

The  developmental  sample  f^om  the  first  eight  years  contained  7668 
observations,  and  the  verification  sample  from  the  last  two  years 
contained  2332  observations. 

% 

Result  3 

The  four  sets  of  predictors  selected  by  MDA  and  REEP  are  shown  in 
Tables  lA-5a  to  1A-5d  in  addition  to  the  REEP  regression  coefficients 
far  each  group  of  the  predictand.  The  contingency  tables  (see  Tables 
1A-6a  to  lA-6d)  give  the  forecast-versus-observed  frequencies  for 
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persistence;  MPA;  and  REEP.  The  number  of  hits,  the  P  scores,  and 
the  individual  group  contributions  to  the  P  score  are  also  shown. 
Table  1A-7  suimnarizes  the  number  of  correct  forecasts  and  the  over- 
all  P  scores. 

Conclusions 

1)  In  the  Atlantic  City  experiment  (Experiment  1)  the  selected 
predictors  for  REEP  and  MDA  are  both  alike  in  numbers  and  in  kind. 
However,  in  the  Offutt  experiment  (Experiment  1A)  this  is  not  the 
ease.  There  are  many  more  predictors  selected  as  significant  in 
REEP.  This  iu  due  to  two  adjustable  factors  introduced  into  the 
REEP  computer  program  for  the  Offutt  experiment  but  not  far  the 
Atlantic  experiment. 

The  first  of  these  is  that  in  REEP  each  group  can  be  as¬ 
signed  its  earn  effective  degrees  of  freedom  determinable  from  &  runs 
test,  whereas  MDA  must  use  an  average  number  (from  previous  studies 
determined  empirically  to  be  at  about  one- third  the  developmental 
sample  size  or  roughly  crediting  only  one  observation  a  day  as  in¬ 
dependent).  Most  of  these  additional  selected  predictors  explain 
a  significant  amount  of  variability  in  the  lew  ceiling  and  visibility 
categories. 

Another  adjustable  factor  is  that  of  minimum  frequency  in 
the  number  of  observations  far  a  possible  predictor  (in  our  termi¬ 
nology  "bit  count").  In  order  for  a  predictor  to  be  selected  it 
must  have  been  observed  at  least  a  minimum  number  of  times  in  the 
developmental  sample .  This  is  an  adjustable  input  parameter  to  the 
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program*.  A  more  detailed  discussion  on  its  effects  is  given  in  a 
subsequent  experiment.  Suffice  it  to  say  that  for  larger  values 
it  selects  more  stable  predictors  with  a  tendency  toward  predictor 
selection  to  favor  higher  ceiling  and  visibility  categories.  An 
additional  effect  is  that  for  larger  values  it  would  select  fewer 
predictors  thus  offsetting  some  of  the  effects  due  to  the  degrees 
of  freedom  factor. 

2)  A  summary  of  the  results  shows  MDA  with  ten  asterisks  in 
its  favor  vfoile  REEP  has  eight.  In  almost  every  instance  where  an 
individual  P  score  or  the  number  of  hits  differ  this  difference  is 
very  small.  We  conclude  that  for  all  practical  purposes  MDA  and 
REEP  produce  comparable  results. 


*The  present  MDA  program  now  has  this  as  an  input  parameter.  At  the 
time  of  the  Atlantic  City  and  Offutt  comparisons  it  was  not  available. 
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Table  1A-1 
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Table  1A-2 


Specification  of  Predictands  -  Offutt  AFB,  Nebraska 


*  * 

nloryj 

1 

2 

ZL. 

_ L- 

Predicta nd  variable 

CIG 

CIG 

VIS 

VIS 

Forecast  interval — hours  (H) 

3 

7 

3 

7 

Number  of  Groups  (G) 

5 

5 

4 

4 

Observations  in  Group  1  (n^ ) 

49 

63 

94 

106 

Observations  in  Group  2  (ng) 

373 

379 

212 

213 

Observations  in  Group  3  (n^) 

236 

259 

250 

223 

Observations  in  Group  4  (n,  ) 

959 

920 

7112 

7126 

Observations  in  Group  5  (n^) 

6051 

6047 

- 

Total  dependent  sample  size  (N) 

7668 

7668 

7668 

7668 

Number  of  independent  observations 
in  the  dependent  sar.ple  (n) 

2256 

2256 

2256 

2256 

Degrees  of  Freedom  Group  1 

5400 

5400 

5500 

5500 

far  each  group  n  Group  2 

4600 

4600 

5800 

5800 

(g5*1  »••«»&)  g  Group  3 

5800 

5800 

6300 

6300 

Group  4 

5200 

5200 

4400 

4400 

Group  5 

3500 

3500 

- 

- 

Total  independent  sample  size  (M) 

2332 

2332 

2332 

2332 

Number  of  available  predictors  (P) 

423 

423 

423 

423 
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Table  1A-3 

Number  of  Possible  Predictors  for  the 
3“  and  7—hr  Ceiling  and  Visibility  at  OFF 


Station 


Elem. 

OFF 

GRI 

sux 

DSM 

MKC 

SSH 

LBF 

HON 

MSP 

LNK 

CBI 

SGF 

DCA 

Total 

TOD 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

mm 

- 

5 

DOT 

1 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

1 

CIG 

15 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

- 

70 

VIS 

H 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

- 

58 

WND 

5 

C 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

65 

RLH 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

39 

TCA 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

26 

WEA 

12 

12 

12 

12 

12 

12 

12 

12 

12 

12 

12 

12 

12 

156 

SCL 

3 

- 

- 

- 

- 

- 

- 

- 

_ 

* 

_ 1 

Total  423 
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Table  1A-4 


ope 


--t  Ai  _  jl  .* _ _ J  T  -2 — il  .  •  X»  XV  —  A— «  / rU.^M. \ 

CXlXCav»-LOHB  tuiu  iiimxuo  vx  one  4*?xw*rc?  \A/uu*ujr  / 


Offutt  AFB,  Nebraska 


~wi ~ 

iai  xauxe  o  a  vs  a 


Meteorological  Number  of 

Element  Dummies  Limits  of  Each  Category 


TOD 

DOT 

WND 

RLH 

TCA 


Time  of  Day: 

5  (Same  as  for  ACY  -  see  Table  1~4) 

Day  of  Year: 

1  (Same  as  for  ACY  -  see  Table  1-4) 

Wind: 

5  (Same  as  for  ACY  -  see  Table  1-4) 

Relative  Humidity: 

3  (Same  as  for  ACT  -  see  Table  1-4) 

Total  Cloud  Amount: 

2  (Same  as  for  ACY  -  see  Table  1-4) 


Ceiling  Height,  ft: 


CIG 

5 

1. 

0 

< 

CIG  <  300 

2* 

300 

< 

CIG  <  1000 

3. 

1000 

< 

CIG  <1500 

4. 

1500 

< 

CIG  <  5000 

5. 

5000 

< 

CIG 

Ceiling  Height*,  ft: 

CIG 

10 

0) 

CIG  *  100 

(2) 

CIG  «  200 

(3) 

CIG  -  400 

(4) 

CIG  «  500 

(5) 

CIG  -  900 

♦Parentheses  are  used  here  to  help  distinguish  the  two  forms  of  ceiling 
and  visibility  dummies* 
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Table  1 A-4  -  Continued 


Meteorological  Number  of 
Element  Dummies 


iiiiaiiD  of  Each  watcgory 


VIS 


VIS 


WEA 


4 


10 


12 


Ceiling  Height*,  ft: 

(6)  1500  <  CIG  <  2000 

(7)  2500  <  CIG  <  3000 

(S)  3000  <  CIG  <  5000 

(9)  5000  <  CIG  <  10,000 

(10)  CIG  *  Unlimited 

Visibility,  mi: 


1 . 

0 

< 

VIS 

< 

1 

2. 

1 

< 

VIS 

< 

3 

3. 

3 

< 

VIS 

< 

5 

4. 

5 

< 

VIS 

Visibility*,  mi: 

(D 

1/4 

< 

VIS 

< 

1/2 

(2) 

1/2 

< 

VIS 

< 

3/4 

(3) 

3/4 

< 

VIS 

< 

1 

(4) 

1 

< 

VIS 

< 

1-1/2 

(5) 

1- 

•1/2 

vis 

< 

2 

(6) 

2 

< 

VIS 

< 

3 

(7) 

3 

< 

VIS 

< 

4 

(8) 

4 

< 

VIS 

< 

5 

(9) 

5 

< 

VIS 

< 

6 

(10) 

15 

< 

VIS 

Weather  Element: 

(Same  as  for  ACT  -  see  Table  1*4) 


SCL 


Sky  Condition,  Lower: 

3  (Same  as  for  ACY  -  see  Table  1-4) 


♦Parentheses  are  used  here  to  help  distinguish  the  tvo  forms  of  ceiling 
and  visibility  dummies. 
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Selected  Predictors  and  REEP  Equations 
Offutt  AFB,  Nebraska  ?-hr  Ceiling 
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The  Coefficients  of  the 
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Table  1A-Sc 

Selected  Predictors  and  REEP  Equations 
Offutt  AFB,  Nebraska  3-hr  Visibility 
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Selected  Predictors  and  KEEP  Equations 
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Additive  Constant:  .104  .212 


Table  1 A-6a 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
Tor  Persistence,  MDA,  and  R2EP 

OFF  3 -hr  Ceiling  (Independent  Sample) 


PERSISTENCE 


MDA 


REEP 


Actual 


Group 

1r 

2 

_3 

4l  .  _ 

5 

Total 

1 

o 

/ 

6 

0 

0 

3 

18 

2 

4 

64 

22 

19 

8 

117 

3 

3 

20 

13 

21 

8 

70 

4 

0 

21 

16 

1 99 

119 

355 

5 

1 

11 

16 

122 

1622 

1772 

Total 

17 

122 

72 

361 

1760 

2332 

Hits  = 

1912  P 

-  .2664 

P 

g 

.0053 

.0338 

.0270 

.1000  , 

.1003 

Actual 

GrouD 

1 

2 

3 

.  4.. 

5 

Total 

1 

9 

7 

0 

0 

3 

19 

2 

5 

75 

32 

21 

7 

140 

3 

0 

7 

7 

7 

2 

23 

4 

0 

22 

15 

183 

70 

290 

5 

3 

11 

18 

150 

1 678 

1860 

Total 

17 

122 

72 

361 

1760 

2332 

Hits  = 

1 952  P 

•  .2369 

.  • 

P 

g 

.0054 

.0310 

.0271 

.0888  . 

0845 

Actual 

Group 

1 

.  2 

3 

4_  .. 

5 

Total 

1 

6 

5 

0 

0 

2 

13 

2 

5 

74 

30 

22 

5 

1 36 

3 

0 

6 

5 

3 

1 

15 

4 

0 

23 

16 

177 

62 

278 

5 

6 

14 

21 

159 

1690 

1890 

Total 

17 

122 

72 

36 1 

1760 

2332 

Hits  = 

1952  P 

«=  .2368 

P 

g 

.0057 

.0304 

.0265 

.0897  . 

0845 

39 


Table  1A-6b 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
for  Persistence,  MDA,  and  KEEP 

OFF  7 -hr  Ceiling  (Independent  Sample) 


PERSISTENCE 


MDA 


REEP 


Actual 


Grout) 

1 

2 

_ 3_  _ 

4 

5 

Total 

1 

4 

7 

0 

2 

5 

18 

2 

3 

45 

20 

28 

21 

117 

3 

3 

16 

10 

20 

21 

70 

4 

0 

26 

21 

134 

174 

355 

5 

6 

23 

25 

170 

1543 

1772 

Total 

16 

117 

76 

354 

1769 

2332 

Hits  = 

1741  P 

=  .3319 

P 

g 

.0065 

.0392 

.0301 

.1185  . 

1376 

Actual 

Group 

1 

2 

3 

4  .... 

5 

Total 

1 

1 

2 

0 

0 

1 

4 

2 

7 

57 

28 

41 

20 

153 

3 

1 

0 

1 

i 

1 

4 

4 

0 

27 

17 

94 

53 

191 

5 

7 

31 

30 

218 

1694 

I960 

Total 

16 

117 

76 

354 

1769 

2332 

Hits  = 

1847  P 

-  .2906 

P 

g 

.0065 

.0369 

.0298 

.1090 

,1084 

Actual 

Group 

1 

.  2 

3 

4 

5 

Total 

1 

1 

0 

0 

1 

2 

4 

2 

6 

50 

19 

28 

11 

114 

3 

0 

2 

1 

0 

0 

3 

4 

1 

29 

20 

82 

44 

176 

5 

8 

36 

36 

243 

1712 

2035 

Total 

16 

117 

76 

354 

1769 

2332 

Hits  = 

1846  P 

“  .2890 

P 

g 

.0069 

.0352 

.0285 

.1095 

.1089 
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Table  1 A-6c 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
for  Persistence,  MDA 9  and  RERP 

OFF  3-hr  Visibility  (Independent  Sample) 


PERSISTENCE 


Actual 


Group 

i 

2 

... . 3.  _ 

4 

Total 

1 

24 

11 

7 

6 

48 

2 

12 

18 

16 

17 

63 

3 

4 

14 

18 

32 

68 

4 

6 

20 

39 

2088 

2153 

Total 

46 

63 

80 

2143 

2332 

Hits  = 

2148 

P  «  .1093 

P 

cr 

.0140 

.0227 

.0300 

.0425 

Actual 


Group 

1 

2 

3 

...  ..  4_ 

Total 

1 

13 

5 

3 

3 

24 

2 

15 

23 

14 

8 

60 

3 

3 

7 

6 

8 

24 

4 

15 

28 

57 

2124 

2224 

Total 

46 

63 

80 

2143 

2332 

Hits  “2166 

P  »  .0996 

P 

g 

.0138 

.0214 

.0286 

.0358 

KEEP 


Actual 


Group 

4 

I 

o 

/C 

3  . 

4 

Total 

1 

17 

9 

5 

3 

34 

2 

9 

17 

11 

4 

41 

3 

2 

5 

7 

6 

20 

4 

18 

32 

57 

2130 

2237 

Total 

46 

63 

80 

2143 

2332 

Kits  =  2171 

P  -  .1007 

P 

fir 

.0141 

.0216 

.0287 

.0363 

g 
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Table  1A-6d 


Contingency  Tables  Showing  Predicted-Versus-Aetual  Groups 
for  Persistence,  MDA,  and  ItEEP 

OFF  7-hr  Visibility  (Independent  Sample) 


PERSISTENCE 


MDA 


REEP 


Actual 


Group  t  . ,  2  3  . 4_  TgtSl 


1 

14 

8 

5 

21 

48 

2 

8 

8 

13 

34 

63 

3 

6 

9 

17 

36 

68 

4 

20 

40 

60 

2033 

2153 

Total 

48 

65 

Hits  = 

95 

2072 

2124 

P  *  .1504 

2332 

P 

8 

.0183 

.0261 

.0374 

•0686 

Group 

1 

2 

Actual 

...  3 

-  4.- 

Total 

i 

t 

5 

3 

4 

3 

15 

2 

6 

5 

9 

9 

29 

3 

0 

0 

0 

0 

0 

4 

37 

57 

82 

2112 

2288 

Total 

48 

65 

95 

2124 

2332 

Hits  *  2122  P-.1411 

P 

g 

.0184 

.0256 

.0372 

.0600 

Group 

1 

2 

3 

.4 

Total 

1 

2 

1 

1 

5 

9 

2 

7 

4 

5 

4 

20 

3 

0 

0 

0 

0 

0 

4 

39 

60 

89 

2115 

2303 

Total 

48 

65 

95 

212 4 

2332 

Hits  =  2121 

P  =  .1402 

P 

g 

.0181 

.0255  . 

0368 

.0598 
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Comparison  Between  Persistence,  MDA,  and  REEP 


(Independent  Sample  -  2332  Observations) 

Offutt  APB,  Ceiling  3  Hours  in  Advance 

Persistence  1912 

Hits  MDA  1952* 

REEP  1952* 

Persistence  .2664 

P  Score  MDA  .2369 

REEP  .2368* 

Offutt  AFB,  Ceiling  7  Hours  in  Advance 

Persistence  1741 

Hits  MDA  1847* 

REEP  1846 

_  Persistence  .3319 

P  Score  MDA  .2906 

REEP  .2890* 

Offutt  AFB.  Visibility  3  Hours  in  Advance 

Persistence  2148 

Hits  MDA  2166 

REEP  2171* 

Persistenc  e  . 1 093 

P  Score  MDA  .0996* 

REEP  .1007 

Offutt  AFB,  Visibility  7  Hours  in  Advance 

Persistence  2072 

Hits  MDA  2122* 

REEP  21 21 

Persistence  .1504 

P  Score  MDA  .1411 

REEP  .1402* 


Asterisks  are  used  to  denote  superiority 


Purpose 


A  test  to  compare  the  results  obtained  when  the  predictor  variables 
are  in  raw  dummy  form  to  those  obtained  when  the  predictor  dummies  are 
in  cumulative  form. 

Predicta nds 

Predictanas  used  in  this  experiment  were  the  Atlantic  City  ceilings 
for  periods  of  2,  t>,  and  7  hours  in  advance.  These  three  predictands  were 
divided  into  five  intervals  according  to  the  operationally  significant 
categories  of  ceiling,  as  shown  in  Table  2-1*  Specifications  for  each 
predictand  are  shown  in  Table  2-2. 

Predictors 

Seven  meteorological  elements  at  ten  predictor  stations  (see  Figure 
2-1)  plus  the  time  of  day  (TOD)  and  day  of  year  (DOY)  variables  were 
transformed  into  dummy  variables  by  dividing  each  predictor  element  into 
a  number  of  intervals  or  categories  (Table  2-3). 

Data  Sample 

The  data  used  for  this  experiment  is  the  same  as  was  used  for 
Experiment  No.  1  ,  consistir^  of  10,000  observations  selected  randomly 
from  the  ten-year  period  from  1  January  1949  to  31  December  1958.  The 
developmental  sample  consists  of  7956  observations  from  the  first  eight 
years  and  the  verification  or  independent  sample  contains  2044  obser¬ 
vations  from  the  last  two  years. 
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The  set  of  450  standard  form  dummy  predictors  are  shown  in  Table 
2-3*  Table  2-4  tabulates  the  cumulative  dummy  predictors.  Table  2-5 
gives  the  specifications  and  limits  of  the  dummy  variables  when  used 
in  the  standard  form  and  Table  2-6  gives  similar  information  when  the 
predictors  are  in  the  cumulative  dummy  form,.  Predictions  using  REEP 
were  made  for  Atlantic  City  ceiling  at  2,  5>  and  7  hours  in  advance 
using  the  standard  dummies  and  the  cumulative  dummies  separately. 
Results 

The  dummy  predictors  selected  by  REEP  are  shown  in  Tables  2-7a 
to  2-7f,  as  well  as  the  REEP  regression  equation  coefficients  for 
each  group  of  the  predictand.  Results  of  the  forecasts  usirg  the 
two  sets  of  predictors  are  shown  in  the  contingency  tables  (Tables 
2-8a  to  2-8c)  for  the  independent  sample.  Also  shown  are  the  results 
using  persistence.  The  number  of  correct  forecasts  (hits),  the 
Brier  and  Allen  P  scores,  and  the  individual  group  contributions 
to  the  overall  P  score  are  given  below  each  contingency  table .  The 
number  of  hits  and  overall  P  scores  are  summarized  in  Table  2-9* 
Conclusions 

From  these  limited  results  there  does  not  appear  to  be  any  reason 
to  prefer  one  form  of  dummy  variables  over  tho  othsr. 
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Definition  of  Predictand  Groups  for  Atlantic  City  Municipal  Airport 


Group 

Number 

1  0  ft  <  Ceiling  <  200  ft 

2  200  ft  <  Ceiling  <  500  ft 

3  500  ft  <  Ceiling  <  1000  ft 

4  1000  ft  <  Ceiling  <  3000  ft 

5  3000  ft  <  Ceiling 


Table  2-2 


Specification  of  Predic.tands 
Atlantic  City  Municipal  Airport 


Predictana 


1 

2 

_ 2_ 

Predictand  variable 

CIG 

CIG 

CIG 

Forecast  interval — hours  (H) 

2 

5 

7 

Number  of  Groups  (G) 

5 

5 

5 

Observations  in  Group  1  (n^) 

116 

128 

135 

Observations  in  Group  2  (n^) 

263 

259 

272 

Observations  in  Group  3  (n^) 

395 

426 

420 

Observations  in  Group  4  (n. ) 

‘  4 

656 

631 

619 

Observations  in  Group  5  (n^) 

6526 

6512 

6510 

Total  dependent  sample  size  (N) 

7956 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

2652 

2652 

2652 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

Number  of  available  predictors  (P) 

378 

378 

378 

Table  2-3 

of  Possible  Predictors  When  Used  in  Standard  Font? 

Station 


Elem. 

ACY 

NEL 

PHL 

SBY 

MDT 

DCA 

PSB 

BGM 

RIC 

IDL 

Total 

TOD 

1 

— 

- 

— 

- 

— 

- 

— 

— 

— 

1 

DOY 

1 

- 

- 

- 

- 

- 

- 

- 

- 

1 

CIG 

24 

5 

5 

5 

5 

5 

5 

5 

5 

5 

69 

VIS 

24 

s 

5 

5 

5 

5 

5 

5 

5 

5 

69 

UWC 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

50 

VWC 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

50 

RLH 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

50 

TCA 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

40 

WEA 

12 

12 

12 

12 

12 

12 

12 

12 

12 

12 

120 

Total 


450 


Table  2-4 


Number  of  Possible  Predictors  When  Used  in  Cumulative  Form 


Station 


Elem. 

ACY 

NEL 

PHL 

SBY 

MDT 

DCA 

PSB 

BGM 

RIC 

_  IDL 

Total 

TOD 

1 

- 

— 

- 

- 

• 

- 

- 

— 

- 

1 

DOY 

1 

- 

- 

- 

- 

- 

- 

- 

- 

- 

1 

CIG 

22 

4 

4 

4 

4 

4 

4 

4 

4 

4 

58 

VIS 

22 

4 

4 

4 

4 

4 

4 

4 

4 

4 

58 

UWC 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

40 

VWC 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

40 

RLH 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

40 

TCA 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

30 

WEA 

11 

11 

11 

11 

11 

11 

11 

11 

11 

11 

110 

Total  378 


Table  2-5 


Specifications  and  Limits  of  the  Zero-One  (Dummy)  Variables 
Used  in  the  Standard  Dummy  Form 


Meteorological 
Element _ 


TOD 


Number  of 
Dummies 


DOY 


CIG* 


19 


Limits  of  Each  Category 
Time  of  Day: 

1.  0130  EST  to  1330  EST 

Day  of  Year: 

1.  From  151  (31  May)  to  300  (27  Oct) 
Ceiling  Height,  ft: 


1 . 

0 

< 

CIG 

< 

200 

2. 

200 

< 

CIG 

< 

500 

3. 

500 

< 

CIG 

< 

1000 

4. 

1000 

< 

CIG 

< 

3000 

5o 

3000 

< 

CIG 

(1) 

CIG 

3X 

0 

(2) 

CIG 

= 

100 

(3) 

CIG 

=3 

200 

(4) 

CIG 

SX 

300 

(5) 

CIG 

= 

400 

(6) 

CIG 

- 

500 

(7) 

CIG 

= 

600 

(6) 

CIG 

700 

(9) 

CIG 

®= 

800 

(10) 

CIG 

= 

900 

(11) 

1000 

< 

CIG 

< 

1500 

(12) 

1500 

< 

CIG 

< 

2000 

(13) 

2000 

< 

CIG 

< 

2500 

(14) 

2500 

< 

CIG 

< 

3000 

(15) 

3000 

< 

CIG 

< 

5000 

(16) 

5000 

< 

CIG 

< 

10,000 

*The  predictand  station  (aCY)  has  ceiling  and  visibility  dummied  in  two 
ways.  Parentheses  are  used  to  identify  the  second  set  of  dummies. 
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Table  2-5  -  Continued 


i/-.  x.  .  - _ n  _ “i 

Element 


M _ > _ 

1UUUUC1  Ui 


Dummies  Limits  of  Each  Category 


VIS* 


19 


Ceiling  Height,  ft: 

(17)  10,000  <  CIG  <  20,000 

(18  )  20,000  <  CIG  <  Unlimited 

(19)  CIG  =  Unlimited 

Visibility,  mi: 


1 . 

0 

< 

VIS 

< 

1/2 

2. 

1/2 

< 

VIS 

< 

1 

3. 

1 

< 

VIS 

< 

2 

4. 

2 

< 

VIS 

< 

3 

5. 

3 

< 

VIS 

(D 

0 

< 

VIS 

< 

1/1 6 

(2) 

1/16 

< 

VIS 

< 

1/8 

(3) 

1/8 

< 

VIS 

< 

1/4 

(4) 

1/4 

< 

VIS 

< 

1/2 

(5) 

1/2 

< 

VIS 

< 

3/4 

(6) 

3/4 

< 

VIS 

< 

1 

(7) 

1 

< 

VIS 

< 

1-1/2 

(8) 

1-1/2 

< 

VIS 

< 

2 

(9) 

2 

< 

VIS 

< 

3 

(10) 

3 

< 

VIS 

< 

4 

(11) 

4 

< 

VIS 

< 

5 

(12) 

5 

< 

VIS 

< 

6 

(13) 

6 

< 

VIS 

< 

7 

(14) 

7 

< 

VIS 

V 

S 

(15) 

8 

< 

VIS 

< 

9 

06) 

9 

< 

VIS 

< 

10 

(17) 

10 

< 

VIS 

< 

11 

*The  predictand  station  (ACT)  has  ceiling  and  visibility  dummies  in  two 
ways.  Parentheses  are  used  to  identify  the  second  set  of  duramj.es. 


Table  2-5  -  Continued 


Vq+  A/N1«a1  AfT^  nal 

»»VVVV* 

Element 


Number  ot 
Dummies 


Limits  of  Each  Category 
Visibility ,  mi: 

(18)  11  <  VIS  <  15 

(19)  15  <  VIS 

nUK  Wind  Component  (East-West  Comp.) 

1.  UWC  <  -15 

2.  -15  <  UWC  <  -  5 

3.  -  5  <  UWC  <  5 

4.  5  <  UV/C  <  15 

5.  15  <  UWC 

11 V1*  Wind  Component  (North-South  Comt 

1.  VWC  <  -15 

2.  -15  <  VWC  <  -  5 

3.  -  5  <  VWC  <  5 

4.  5  <  VWC  <  15 

5.  15  <  VWC 

Relative  Humidity,  per  cent: 

1.  RLH  <  50 

2.  50  <  RLH  <  75 

3.  75  <  RLH  <  90 

4.  90  <  RLH  <  99 

5.  99  <  RLH 


Total  Cloud  Amount: 

1.  TCA  <  1/10 

2.  1/10  <  TCA  <  5/10 

3.  5/10  <  TCA  <  9/10 

4.  9/10  <  TCA 
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Table  2-5  -  Continued 


Meteorological 

Element 


WEA 


Number  of 

Dummies  Limits  of  Each  Category 

Weather  Element:  Teletype  Code- 

12  1.  No  Weather 


2 .  Rain 

R- ,  R,  R+ 

3.  Rain  Showers 

RW-,  RW,  RVfh 

4.  Drizzle  or 

L-,  L,  L+ 

Freezing  Drizzle 

ZL-,  ZL,  ZL+ 

5 .  Snow 

S-,  S,  S+ 

Snow  Pellets 

SP-,  SP,  SF4- 

Snow  Grains 

SG-,  SG,  SG+ 

Ice  Crystals 

IC-,  IC,  IC+ 

6.  Snow  Showers 

SW-,  SW,  SW+ 

Snow  Squalls 

SQ-,  SQ,  SQ*- 

7.  Tornado 

Tornado 

Thunderstorm 

T,  Tf 

Squalls 

Q- ,  Q,  Of 

Hail 

A-,  A,  A+ 

Hail  Pellets 

AP-,  AP,  AF+ 

8.  Freezing  Rain 

ZR-,  ZR,  ZR+ 

Sleet 

E-,  E,  E+ 

Sleet  Showers 

EW-,  EW,  EW+ 

9.  Fog,  Ice  Fog 

F,  IF 

10.  Ground  Fog 

GF 

1 1 .  Blowing  Snow 

BS 

Blowing  Sand 

BN 

Blowing  Dust 

BD 

12.  Smoke,  Haze,  Dust 

K,  H,  D 
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Table  2~6 


Specifications  aid  Limits  of  the  Zero-One  (Dummy)  Variables 

n a  4  _  of  Hv®  rhunmtr  F^rm 


V  DCU  <U1  UUV  vwimuam  * 


18  (1)  GIG  -  0 

(2)  CIG  <  100 

(3)  CIG  <  200 

(4)  CIG  <  300 

(5)  CIG  <  400 

(6)  CIG  <  500 

(7)  CIG  <  600 

(8)  CIG  <  700 

(9)  CIG  <  800 

(10)  CIG  <  900 

(11)  CIG  <  1500 

(12)  CIG  <  2000 

(13)  CIG  <  2500 

(14)  CIG  <  3000 

(15)  CIG  <  5000 


*The  predictani  station  (ACT)  has  ceiling  and  visibility  dummied  in  two 
ways.  Parentheses  are  used  to  identify  the  second  set  of  dummies. 
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'SSSttK- 


Table  2-6  -  Continued 


Meteorological  Number  of 
El  enm nt  Dtimmie  s 


Limits  of  Each  Category 


VIS* 


18 


(16) 

CIG 

< 

10,000 

(17) 

CIG 

< 

20,000 

(18) 

CIG 

< 

Unlimiti 

Visibility,  mi: 

1. 

VIS 

< 

1/2 

2. 

VIS 

< 

1 

3* 

VIS 

< 

2 

4* 

VIS 

< 

3 

(1) 

VIS 

< 

1/16 

(2) 

VIS 

< 

1/8 

(3) 

VIS 

< 

1/4 

(4) 

VIS 

< 

1/2 

(5) 

VIS 

< 

3/4 

(6) 

VIS 

< 

1 

(7) 

VIS 

< 

1-1/2 

(8) 

VIS 

< 

2 

(9) 

VIS 

< 

3 

(10) 

VIS 

< 

4 

(11) 

VIS 

< 

5 

(12) 

VIS 

< 

6 

(13) 

VIS 

< 

7 

(14) 

VIS 

< 

8 

(15) 

VIS 

< 

9 

(16) 

VIS 

< 

10 

07) 

VIS 

< 

11 

(18) 

VIS 

< 

15 

*The  predictand  station  (ACT)  has  ceiling  and  visibility  dummied  in  two 
ways*  Parentheses  are  used  to  identify  the  second  set  of  dummies* 
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■ — try 


Table  2-6  -  Continued 


Meteorological 

Element 


UWC 


VWC 


RLH 


TCA 


Number  of 

Dummies  Limits  of  Each  Category 


»U»  Wind  Component  (East-West  Comp.): 

1.  UWC  <  -15 

2.  UWC  <  -  5 

3.  UWC  <  5 

4.  UWC  <  15 


4 

t. 

VWC 

< 

-15 

2. 

VWC 

< 

-  5 

3. 

VWC 

< 

5 

4* 

VWC 

< 

15 

Relative  Humidity, 

4 

t. 

RLH 

< 

50 

2. 

RLH 

< 

75 

3. 

RLH 

< 

90 

4« 

RLH 

< 

99 

Total  Cloud  Amount 

3 

1. 

TCA 

< 

1/10 

2. 

TCA 

< 

5/10 

3. 

TCA 

< 

9/10 
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Table  2-6  -  Continued 


Meteorological 

Element 


WEA 


Number  of 

Dummies  Limits  of  Each  Category 


11 


Weather  Element: 

1 .  No  Weather 
2 •  Rain 

3.  Rain,  Rain  Showers 

4.  Rain,  Rain  Showers 
Freezing  Rain,  Sleet 
Sleet  Showers 

5.  Drizzle 
Freezing  Drizzle 

6.  Snow 

Snow  Pellets 
Snow  Grains 
Ice  Crystals 


Teletype  Code 


(See  Table  2-5) 


7.  Snow 

Snow  Pellets 
Snow  Grains 
Ice  Crystals 
Snow  Shcwers 
Snow  Squalls 

8,  Tornado 
Thunderstorm 
Squalls 
Hail 

Hail  Pellets 
9*  Fog,  Ice  Fog 

10.  Fog,  Ice  Fc^ 
Ground  Fog 

1 1 .  Smoke ,  Haze ,  Dust 
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Table  2- 7a 


Selected  Predictors  and  REEF  Equations 
ACY  2-hr  Ceiling  -  Standard  Dummies* 


Order 

Selected  Predictor 
Station  Element 

s 

Dummy* 

Coefficients  of  the  PEEP  Equations 
A1  A2  A3  A4  A5 

1 

ACY 

CIG 

5 

-  .006 

.013 

-.016 

-.349 

.358 

2 

ACY 

CIG 

1 

.294 

.267 

-.089 

-.415 

-.057 

3 

ACY 

CIG 

2 

.027 

.402 

.001 

-.395 

-.035 

4 

PHL 

CIG 

5 

.012 

-.026 

-.071 

-.112 

.198 

5 

ACY 

CIG 

3 

.002 

.081 

.283 

-.347 

-.019 

6 

SBY 

CIG 

5 

.000 

-.069 

-.053 

.001 

.121 

7 

NEL 

TCA 

4 

.000 

.001 

.010 

.044 

-.055 

6 

ACY 

CIG 

(0 

.240 

-J47 

-.001 

.008 

-.100 

9 

NEL 

CIG 

3 

-.064 

-.050 

.092 

.044 

-.022 

10 

ACY 

VIS 

5 

-.036 

-.011 

-.023 

.030 

.041 

11 

DCA 

CIG 

2 

.095 

-.004 

-.088 

.029 

-.032 

12 

NEL 

CIG 

4 

-.058 

to 

o 

. 

i 

-.024 

.144 

-.013 

13 

nel 

CIG 

5 

-.063 

-.038 

vO 

tn 

o 

. 

t 

.063 

.074 

14 

DCA 

CIG 

5 

.006 

-.015 

-.024 

-.039 

.071 

15 

BGM 

WEA 

8 

.146 

-.104 

-.056 

-.024 

.038 

16 

PHL 

WEA 

2 

-.023 

.063 

.046 

-.003 

-.083 

17 

DCA 

VIS 

1 

.148 

-.072 

-.051 

-.022 

-.003 

13 

SBY 

CIG 

4 

-.007 

-.068 

-.058 

.108 

.025 

19 

PHL 

UWC 

2 

-.000 

.021 

.016 

.026 

-.064 

20 

ACY 

VIS 

(5) 

.103 

-.035 

-.011 

-.055 

-.002 

Additive 

Constant t 

.089 

.143 

.221 

.413 

.134 

*Refer  to  Table  2-5. 
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Table  2 -7b 


Selected  Predictors  and  KEEP  Equations 
ACY  2-hr  Ceiling  -  Cumulative  Dummies* 


Selected  Predictors 
Order  Station  Element  Dummy* 


1 

ACY 

CIG 

4 

2 

ACY 

CIG 

1 

3 

ACY 

CIG 

2 

4 

PHL 

CIG 

4 

5 

ACY 

CIG 

3 

6 

SBY 

CIG 

4 

7 

ACY 

VIS 

(5) 

8 

NEL 

TCA 

3 

9 

DCA 

CIG 

2 

10 

ACY 

CIG 

(1) 

11 

NEL 

CIG 

3 

12 

H>L 

UWC 

2 

13 

SBY 

CIG 

3 

14 

ACY 

CIG 

(12) 

15 

ACY 

RLH 

4 

16 

DCA 

CIG 

4 

17 

NEL 

CIG 

2 

18 

SBY 

VIS 

2 

19 

PHL 

VvEA 

4 

Additive  Constant: 


•KRefer  to  Table  2-6. 


Coefficients  of  the  KEEP  Equations 


A1 

A2 

A3  . 

*4 

hr 

.009 

-.012 

-.005 

.301 

-.292 

.232 

-.109 

-.072 

-.036 

...015 

.036 

.313 

-.272 

-.05! 

-.026 

-.011 

.024 

.073 

.125 

-.211 

.010 

.083 

.269 

-.401 

.038 

-.008 

.001 

-.006 

.111 

-.098 

.098 

-.104 

-.003 

.024 

-.015 

-.002 

.001 

-.008 

-.053 

.063 

.103 

-.033 

-.074 

.006 

-.002 

.208 

-.129 

.008 

.009 

-.097 

-.000 

-.007 

.117 

-.067 

-  .044 

.009 

.009 

.028 

.014 

-.059 

.000 

.069 

.075 

-.115 

-.029 

-.002 

-..006 

.038 

.127 

-.157 

.009 

-.064 

-.0C1 

.060 

-.003 

-.007 

.017 

.023 

O042 

-.076 

.057 

.057 

-.079 

-.037 

.002 

.056 

.017 

-.075 

.002 

-.001 

-.006 

.032 

.035 

.017 

-.078 

-.006 

.061 

.007 

.001 

.937 
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Table  2-7c 


n  •»  .  a  j  ft...  Ji  .i  ...  _  .  4  AM«> 

ociecieu  rrcuicturo  aiw  rwcir.r  ^uauxuno 

ACY  5-hr  Ceiling  -  Standard  Dummies* 


Order 

Selected 

Station 

Predic tors 

Element  Dummy* 

Coefficients 
A1  A2 

of  the  REEP  Equations 
A.  Ac 

_ 1 _ Ik _ _2 _ 

1 

ACS 

CIG 

5 

-.003 

-.002 

-.006 

-.154 

.166 

2 

DCA 

CIG 

5 

-.026 

-.107 

-.032 

.018 

.147 

3 

PHL 

CIG 

5 

.001 

-.024 

-.045 

-.070 

.139 

4 

ACY 

CIG 

1 

.183 

.078 

.092 

-.229 

-.124 

5 

PHL 

UWC 

2 

-.000 

.044 

.043 

.032 

-.119 

6 

ACY 

CIG 

2 

.045 

.168 

.048 

-.266 

.005 

7 

MDT 

TCA 

4 

-.003 

.013 

.016 

.052 

-.078 

8 

SBY 

CIG 

5 

-.004 

.010 

-.031 

-.075 

.100 

9 

DCA 

CIG 

4 

-.028 

-.102 

.011 

.105 

.014 

10 

MDT 

WEA 

2 

-.011 

.042 

.101 

-.027 

-.105 

11 

ACY 

TCD 

1 

-.027 

—.01 4 

.002 

.032 

.007 

12 

ACY 

CIG 

3 

.008 

.055 

.108 

-.143 

-.028 

13 

ACY 

VIS 

5 

-.050 

.017 

-.005 

-.018 

.056 

14 

IDL 

CIG 

5 

-.012 

-.009 

0 

0 

• 

1 

-.035 

.086 

15 

SBY 

WEA 

9 

.002 

.068 

.046 

-.022 

-.094 

16 

IDL 

UWC 

2 

.005 

,008 

.040 

.026 

-.080 

Additive 

Constant : 

.111 

.117 

.143 

.330 

.298 

*Refer  to  Table  2-5. 
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Table  2-7d 


Selected  Predictors  and  RUT3  Equations 
ACT  5-hr  Ceiling  -  Cumulative  Dummies* 


Order 

Selected  Predictors 

Station  Element  Dummy* 

Coefficients  of  the  REEP  Equations 
A1  A2  A3  A4  A5 

1 

ACT 

CIG 

(13) 

.002 

.004 

.021 

.156 

-.182 

2 

DCA 

CIG 

4 

-.002 

.004 

.040 

.089 

-.131 

3 

PHL 

CIG 

4 

.000 

.025 

.044 

.075 

-.144 

4 

ACT 

CIG 

(3) 

.122 

-.110 

.010 

.003 

-.025 

5 

PHL 

UWC 

2 

-.000 

.040 

.051 

.029 

-.120 

6 

ACT 

CIG 

2 

.024 

.137 

-.049 

-.109 

-.004 

7 

MDT 

TCA 

3 

.004 

-.014 

-.015 

-.051 

.075 

8 

SET 

CIG 

4 

.005 

-.012 

.027 

.079 

-.100 

9 

IDL 

RLH 

2 

-.012 

-.004 

-.020 

-.034 

.070 

to 

DCA 

CIG 

3 

.026 

.105 

-.009 

-.103 

-.019 

11 

MDT 

MEA 

2 

-.012 

.038 

.095 

-.032 

-.089 

12 

ACT 

TCD 

1 

-.026 

-.014 

.003 

.032 

.005 

13 

ACT 

CIG 

3 

.010 

.053 

.102 

-.148 

-.018 

14 

SBT 

WEA 

9 

.001 

.068 

.044 

-  .026 

-.087 

15 

IDL 

UWC 

2 

•006 

.013 

.037 

.025 

-.081 

16 

ACT 

VIS 

4 

.045 

-.013 

.002 

.011 

-.044 

Additive 

Constant : 

.022 

.018 

.024 

.074 

.862 

■••Refer  to  Table  2-6. 


Table  2-7e 


Selected  Predictors  and  REEP  Equations 
ACY  7=hr  Ceiling  -  Standard  Durcmies* 


Selected  Predictors 
Order  Station  Element  I 


Coefficients  of  the  REEP  Equations 


1 

PHL 

CIG 

5 

.004 

-.035 

-.046 

-.078 

.155 

2 

DCA 

CIG 

5 

-.010 

-.012 

-.040 

-.061 

.122 

3 

ACY 

CIG 

5 

-.017 

-.030 

-.042 

-.076 

.165 

4 

PHL 

UWC 

2 

.003 

.025 

.057 

.042 

-.132 

5 

MDT 

TCA 

4 

-.001 

.013 

.020 

.051 

-.084 

6 

DCA 

WEA 

2 

-.003 

.056 

.125 

-.038 

-.139 

7 

ACY 

VIS 

5 

-.044 

-.001 

.00? 

.020 

.019 

8 

PSB 

WEA 

8 

-.020 

.248 

-.095 

-  .047 

-.086 

9 

ACY 

TOD 

1 

-.028 

-.019 

-.009 

.024 

.031 

10 

RIC 

RIH 

4 

-.005 

.014 

.032 

♦040 

-.081 

11 

MEL 

WEA 

9 

.018 

.019 

.062 

♦013 

-.112 

12 

IDL 

UWC 

2 

.011 

.017 

.035 

.020 

-.082 

13 

ACY 

CIG 

2 

.025 

.101 

.003 

-  .1 32 

.003 

14 

ACY 

CIG 

0) 

.1 55 

-.010 

-.015 

.006 

-.135 

15 

DCA 

CIG 

3 

-.004 

.093 

.007 

-.051 

-.045 

16 

NEL 

UWC 

4 

-.C05 

-.010 

-.011 

-.028 

.054 

Additive 

Constant : 

.087 

.087 

.124 

.212 

.491 

*Refer  to  Table  2-5. 
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Table  2-7f 


Selected  Predictors  and  REEP  Equations 
ACY  ?-hr  Ceiling  -  Cumulative  Pagsies* 


Order 

Selected  Predictors 

Station  Element  Dummy* 

Coeffiv. 

A, 

dents  of  the  REEP  Equations 
A2  A3  A4  A5 

1 

PKL 

CIG 

4 

-.004 

.025 

.047 

.082 

-.151 

2 

DCA 

CIG 

4 

.001 

-.002 

.039 

.084 

-.123 

3 

ACY 

CIG 

(13) 

.008 

.018 

.014 

.097 

-.137 

4 

PHI, 

UWC 

2 

.007 

.033 

.063 

.032 

-.135 

5 

MDT 

TCA 

3 

-.000 

-.010 

-.014 

-.049 

.073 

6 

ACY 

VIS 

2 

.091 

-.040 

-.052 

.032 

-.030 

7 

DCA 

WEA 

4 

-.017 

.022 

.094 

-.020 

-.079 

8 

IDL 

RLH 

2 

-.008 

.000 

-.017 

-.040 

.066 

9 

DCA 

CIG 

3 

.016 

.098 

.004 

-.093 

-.025 

10 

ACY 

TCD 

1 

-.027 

-.018 

-.004 

.027 

.023 

11 

NEL 

UWC 

3 

.006 

.008 

.012 

.030 

-.057 

12 

SBY 

WEA 

9 

.010 

.044 

.019 

.039 

-.113 

13 

ACT 

CIG 

(9) 

.037 

.064 

.072 

-.134 

-.038 

U 

IDL 

UWC 

2 

.011 

.017 

.030 

.020 

-.078 

15 

PHL 

WEA 

4 

-.000 

.056 

.029 

-.027 

-.057 

Additive 

Constant: 

.021 

.011 

.021 

.069 

.878 

*Refer  to  Tafale  2-6. 
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Table  2-8a 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
for  Persistence.  REEP  with  Standard  Dummies, 
and  REEP  with  Cumulative  Dummies 

2-hr  Ceiling  (Independent  Sample) 

Actual 


Group 

1 

2 

3 

4  _ 

5 

Total 

1 

26 

4 

3 

0 

5 

38 

PERSISTENCE 

2 

8 

48 

22 

6 

6 

90 

3 

4 

10 

57 

24 

13 

108 

4 

2 

4 

24 

72 

66 

168 

5 

4 

9 

16 

55 

1556 

1640 

Total 

44 

75 

122 

157 

1646 

2044 

Hits  « 

1759  P 

“  .2063 

P 

g 

.0128 

.0241 

.0407 

.0590  , 

.0696 

Actual 

Group 

1 

2 

. ..3 . . . 

4 

5 

Total 

1 

19 

2 

2 

0 

4 

27 

REEP  with 

2 

11 

46 

21 

5 

2 

85 

Standard 

3 

3 

8 

52 

21 

10 

94 

Dummies 

4 

2 

4 

21 

58 

31 

116 

5 

9 

15 

26 

73 

1599 

1722 

Total 

44 

75 

122 

157 

1 646 

2044 

Hits  = 

1774  P 

=  .1878 

P 

g 

.0138 

.0237 

.0369 

.0558  , 

►0575 

Actual 


Group 

1 

1 

2 

3 

4  _ 

§ 

Total 

25 

3 

3 

0 

4 

35 

REEP  with 

2 

6 

46 

21 

5 

2 

80 

Cumulative 

3 

3 

8 

52 

19 

10 

92 

Dummies 

4 

1 

4 

24 

56 

26 

111 

5 

9 

14 

22 

77 

1604 

1726 

Total 

44 

75 

Hits  -  1783 

122 

157 

P  =  .1884 

1646 

2044 

P 

g 

.0134 

.0236  . 

0367 

.0571  , 

.0576 
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Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
for  Persistence,  REBP  with  Standard  Dummies, 
and  BEEP  with  Cumulative  Dummies 

V 

5 -hr  Ceiling  (Independent  Sample) 


Actual 


Group 

1 

.  2 

3 

...  4_ 

5 

Total 

t 

11 

11 

6 

2 

8 

38 

2 

7 

34 

IS 

15 

16 

90 

PERSISTENCE 

3 

3 

13 

38 

28 

26 

108 

4 

2 

11 

29 

47 

79 

168 

5 

9 

15 

31 

82 

1503 

1640 

Total 

32 

84 

122 

174 

1632 

2044 

Hits  * 

1633  P 

=  .2689 

P 

g 

.0138 

.0326 

.0489 

.0723  , 

.1013 

Actual 

Group 

1 

2 

3 

4 . 

5 

Total 

1 

1 

1 

1 

0 

0 

3 

REEP  with 

2 

3 

24 

7 

6 

2 

42 

Standard 

3 

7 

20 

32 

17 

8 

84 

Dummies 

4 

0 

10 

24 

23 

11 

68 

5 

21 

29 

58 

128 

1611 

1847 

Total 

32 

84 

122 

174 

1632 

2044 

Hits  « 

169 1  P 

»  .2375 

P 

g 

.0136 

.0310 

.0460 

.0687  . 

.0782 

Actual 

Group 

1 

2 

.  3 

4 

5 

Tots* 

• 

1 

0 

0 

0 

1 

0 

1 

REEP  with 

2 

1 

19 

8 

4 

3 

35 

Cumulative 

3 

9 

23 

31 

17 

5 

85 

Dummies 

4 

0 

9 

21 

18 

9 

57 

5 

22 

33 

62 

134 

1615 

1866 

Total 

32 

84 

122 

174 

1632 

2044 

Hits  » 

1683  P 

*  .2367 

.0137 

.0310 

.0459 

.0685  ■ 

.0776 
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Table  2-8 c 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
for  Persistence,  REEP  with  Standard  Efessaies, 
and  REEP  with  Cumulative  Dummies 

7-hr  Ceiling  (Independent  Sample) 

Actual 


9&S* 2  -1 _ l _ 2 _ 4 _ iL  Total 


1 

8 

12 

8 

4  6 

38 

2 

12 

22 

19 

19  18 

90 

PERSISTENCE 

3 

7 

9 

38 

26  28 

108 

4 

2 

12 

33 

37  84 

168 

5 

12 

24 

49 

72  1483 

1 640 

Total 

41 

79 

147 

158  1619 

2044 

Hits  = 

1588 

P 

=  .2899 

«w 

p 

'g 

.0183 

.0342 

.0598 

.0671  .1105 

Actual 

Group 

1 

3 

4  5 

Total 

1 

0 

1 

0 

0  0 

1 

REEP  with 

2 

1 

8 

5 

0  3 

17 

Standard 

3 

9 

22 

32 

9  7 

79 

Dummies 

4 

7 

6 

18 

12  5 

48 

5 

24 

42 

92 

137  1604 

1899 

Total 

41 

79 

147 

158  1619 

2044 

Hits  « 

1656 

P 

-  .2617 

*g 

.0184 

.0322 

.0547 

.0668  .0896 

Actual 


Group 

1 

2 

...  -  3 

4 

5 

Total 

1 

0 

0 

0 

0 

0 

0 

REEP  with 

2 

5 

9 

6 

1 

0 

21 

Cumulative 

3 

7 

19 

28 

10 

4 

68 

Dummies 

4 

4 

7 

21 

10 

9 

51 

5 

25 

44 

92 

137 

1606 

1904 

Total 

41 

79 

1 47 

158 

1619 

2044 

Hits  * 

1 653 

P  «  .2621 

T> 

a 

g 

.0182 

.0323 

.0556 

.0674 

.0885 
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Table  2~9 


Comparison  Between  Persistence,  KEEP  with  Standard  Dummies,  and  KOa* 
with  Cumulative  Dummies  for  the  Independent  Sample  (20 44  Observations) 


2-hr  Ceiling 

Persistence 

1759 

Hits 

Standard 

1774 

Cumulative 

1783* 

Persistence 

.2063 

P  Score 

Standard 

.1878* 

Cumulative 

.1884 

5-hr  Ceiling 

Persistence 

1633 

Hits 

Standard 

1691* 

Cumulative 

1683 

Persist  ence 

.2689 

P  Score 

Standard 

.2375 

Cumulative 

.2367* 

HirCeilin^ 

Persist  ence 

1588 

Hits 

Standard 

1656* 

Cumulative 

1653 

Persistence 

.2899 

P  Score 

Standard 

.2617* 

Cumulative 

.2621 

Asterisks  are  used  to  denote  superiority. 
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EXPERIMENT  3.  Nullifying  the  Effect  of  High  Ceilings  in  Predictor 
Selection. 


Purpose 

To  determine  the  effect  on  the  forecast  of  assuming  a  zero  degree 
of  freedom  for  category  5  of  the  ceiling  predictand. 

Procedure 

Forecasts  were  made  for  ceiling  at  Atlantic  City  3  hours  and  7 
hours  in  advance.  The  degrees  of  freedom  specified  for  categories  1 
through  4  of  the  ceiling  predictand  was  specified  as  2652,  the  number 
normally  used  for  the  Atlantic  City  developmental  sample  size  of  7956, 
or  one-third  of  the  total  developmental  sample .  The  degrees  of  freedom 
for  category  5  of  the  ceiling  predictand  was  specified  as  zero.  This 
in  effect  eliminated  the  possibility  of  having  category  5  affect  the 
selection  of  any  predictor. 

Data  Sample 

The  ten  years  of  data  from  1  January  1949  to  31  December  1958, 
consisting  of  10,000  observations  selected  at  random  was  used  in  this 
experiment.  The  developmental  sample  consisted  of  7956  observations 
from  the  first  eight  years  and  the  verification  or  dependent  sample 
of  2044  was  from  the  last  two  years  of  the  data  sample. 

Predictand s 

The  ceiling  at  time  intervals  of  )  and  7  hours  in  advance  were 
the  predictands  for  this  experiment.  The  operationally  significant 
categories  for  which  the  forecasts  were  made  are  shown  in  Table  3-1. 

The  specifications  are  shown  in  Table  3m2. 
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Predictors 


The  set  of  423  dummy  predictors  used  in  Experiment  No.  1  for  the 
13-station  Atlantic  City  network  was  used  for  this  experiment  (see 
Figure  1-1  and  Tables  1-3  and  1-4). 

Results 

The  predictors  selected  by  REEP  for  each  of  the  predictands  are 
given  in  Tables  3-3a  and  3-3b,  as  well  as  the  coefficients  in  the  REEP 
regression  equation  for  each  group  of  the  predictand.  Contingency 
tables  showing  the  forecast- versus -observed  frequencies  for  REEP  with 
zero  degree  of  freedom  in  category  5  and  for  persistence  are  shown  in 
Tables  3-4a  and  3-4b.  The  number  of  correct  forecasts  (hits),  the 
Brier  and  Allen  P  scores,  and  the  individual  group  contributions  to 
the  overall  P  score  are  shown. 

Table  3-5  summarizes  the  hits  and  P  scores  and  compares  them  with 
the  results  using  the  regular  degree  of  freedom  for  all  categories  of 
the  predictand  as  determined  by  Experiment  No.  1  . 

Conclusions 

The  results  in  this  experiment  are  the  same  or  slightly  worse 
than  those  rasing  the  regular  degrees  of  freedom,  both  with  regard  to 
P  score  and  hits  as  well  as  with  regard  to  better  predicting  the  low 
categories.  It  is  therefore  concluded  that  modifying  the  degrees  of 
freedom  within  the  higher  categories  does  not  appreciably  change  the 
results  from  those  obtained  using  the  regular  degrees  of  freedom.  The 
lack  of  success  in  this  effort  to  force  the  selection  of  predictors 
which  contribute  to  improving  the  forecasts  of  low  ceiling  conditions 
suggests  that  the  regular  selection  method  is  performing  this  function 
satisfactorily. 
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Table  3~1 


Definition  of  Predictand  Groups  for  Atlantic  City  Municipal  Airport 


Group 

Number 


Ceiling  Intervals 


0  ft  <  Ceiling  <  200  ft 

200  ft  <  Ceiling  <  500  ft 

500  ft  <  Ceiling  <  1000  ft 

1000  ft  <  Ceiling  <  3000  ft 

3000  ft  <  Ceiling 
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Table  3-2 


Specification  of  Predictands 
Atlantic  City  Municipal  Airport 


Predict and 


1 

2 

Predictand  variable 

CIG 

CIG 

Forecast  interval — hours  (H) 

3 

7 

Number  of  Groups  (G) 

5 

5 

Observations  in  Group  1  (n^ ) 

100 

135 

Observations  in  Group  2  (ng) 

281 

272 

Observations  in  Group  3  (n^ ) 

385 

420 

Observations  in  Group  4  (n^) 

660 

619 

Observations  in  Group  5  (n^) 

6530 

6510 

Total  dependent  sample  size  (N) 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

7956 

7956 

Gfroup  1 

2652 

2652 

Group  2 

2652 

2652 

Group  3 

2652 

2652 

Chroup  4 

2652 

2652 

Group  5 

0 

0 

Total  independent  sample  size  (M) 

2044 

2044 

Number  of  available  predictors  (P) 

423 

423 

72 


Table  3-3 a 


Selected  Predictors  and  R&&r  Equations 
Atlantic  City  3-hr  Ceiling  Forecast 

(Zero  Degrees  Freedom,  Category  5) 


Predictors  Selected 
Order  Station  Element  Dummy 


1 

ACY 

CIG 

2 

2 

ACT 

CIG 

1 

3 

ACY 

CIG 

4 

4 

ACY 

CIG 

3 

5 

FHL 

CIG 

5 

6 

DCA 

ELK 

3 

7 

SBY 

CIG 

4 

8 

SBY 

WEA 

2 

9 

MEL 

CIG 

3 

10 

ACY 

VIS 

5 

11 

ACY 

CIG 

0) 

12 

NEL 

WEA 

2 

13 

ACY 

TCA 

2 

14 

SBY 

CIG 

5 

15 

SBY 

VIS 

2 

16 

ACY 

CIG 

(6) 

17 

NEL 

CIG 

4 

Additive  Constant 


Coefficients  of  the  KEEP  Equations 


A1 

A2 

A3  . 

A5 

.057 

.329 

.025 

-.075 

-.336 

.396 

.202 

.001 

-.146 

-.453 

.008 

.01 6 

.027 

.199 

-.250 

.007 

.082 

.214 

-.013 

-.291 

.008 

-.036 

-.082 

-.143 

.253 

.012 

.079 

.017 

-.033 

-.075 

-.009 

-.079 

-.033 

.089 

.032 

-.009 

.064 

-.002 

.053 

-.124 

-.008 

-.010 

.098 

.008 

-.088 

-.047 

.013 

-.006 

-.001 

.041 

-.176 

.064 

-.069 

.049 

.132 

-.025 

.021 

.087 

-.046 

-.036 

.004 

-.008 

.016 

.054 

-.066 

-.004 

-.071 

-.052 

-.023 

.150 

.085 

.007 

-.037 

-.031 

-.024 

-.009 

-.012 

-.041 

.1 64 

-.102 

-.003 

-.017 

.012 

.082 

-.074 

.045 

.094 

.141 

.180 

.539 
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Selected  Predictors  and  REEP  Equations 
Atlantic  City  ?-hr  Ceiling  Forecast 

(Zero  Degrees  Freedom,  Category  5) 


Predictors  Selected 
Order  Station  Element _ Dx 


Coefficients  of  the  REEP  Equations 


1 

PHL 

CIG 

5 

-.009 

00 

a 

• 

i 

-.060 

-.079 

.195 

2 

DCA 

WEA 

2 

-.003 

.055 

.126 

-.041 

-.136 

3 

ACT 

SCL 

1 

.112 

-.025 

-.01 6 

.006 

-.077 

4 

ACT 

CIG 

2 

.017 

.103 

.019 

-.124 

-.016 

5 

SBT 

CIG 

5 

-.010 

-.000 

-.036 

-.077 

.123 

6 

DCA 

CIG 

3 

.005 

.102 

.055 

.025 

-.187 

7 

PHL 

TCA 

2 

-.003 

.013 

.023 

.055 

-.087 

8 

PSR 

WEA 

8 

-.024 

.243 

-.065 

-.030 

-.105 

9 

ACT 

TOO 

1 

-.026 

-.019 

-.009 

.024 

.030 

10 

NEL 

WND 

2 

-.005 

.038 

.064 

.025 

-.122 

11 

NEL 

WEA 

9 

.028 

.021 

.071 

.015 

-.135 

12 

DCA 

CIG 

4 

.000 

.012 

.047 

.085 

-.145 

13 

PSB 

CIG 

1 

.014 

.098 

-.017 

-.023 

-.072 

14 

BGM 

RLH 

3 

-.004 

-.028 

.008 

.065 

-.041 

15 

PHL 

VOT> 

3 

.029 

.022 

.037 

.042 

-.130 

16 

IDL 

CIG 

3 

.010 

.07  2 

-.004 

-.015 

<2 

vO 

O 

. 

« 

Additive  Constant: 

.037 

.056 

.097 

.157 

.654 
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fable  3-4a 

-  Stamm 


Contingency  Tables  Showing  Predictand-Versus-Actual  Groups 
for  Persistence  and  KEEP  Forecast  With 
Sero  Degree  of  Freedom  in  Category  5 

3~hr  Ceiling  (Verification  Sample) 


Persistence 


Actual 


9 

o 

i 

J _ 

2 

3  . 

.  4. 

5 

Total 

i 

21 

8 

4 

0 

5 

38 

2 

13 

33 

25 

10 

9 

90 

3 

2 

14 

50 

21 

21 

108 

4 

1 

8 

21 

68 

70 

168 

5 

7 

10 

27 

66 

1530 

1640 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  =  1702 

P  -  .2385 

p* 

.0156 

.0284 

.0462 

.0636 

.0847 

Actual 

Group  12  3  4  5  Total 


1 

7 

4 

1 

0 

1 

13 

REEP  With 

2 

18 

34 

24 

8 

7 

91 

Eero  Degree  of 

3 

0 

10 

40 

15 

7 

72 

Freedom  In 

4 

1 

7 

19 

42 

18 

87 

Category  5 

5 

18 

18 

43 

100 

1602 

1781 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  - 

1725 

P  -  .2131 

P 

g 

.0163 

.0275 

.0429 

.0591 

.0673 

/ 
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Table  3 -4b 


Contingency  Tables  Showing  Predictand-Versus-Actual  Groups 
for  Persistence  and  KEEP  Forecast  with 
Zero  Degree  of  Freedom  in  Category  5 

7-hr  Ceiling  (Verification  Sample) 


Persistence 


K 


Actual 


Group 

1 

.  2 

.  3 

4 

5 

Total 

1 

8 

12 

8 

4 

6 

38 

2 

12 

22 

19 

19 

18 

90 

3 

7 

9 

38 

26 

28 

108 

4- 

2 

12 

33 

37 

84 

168 

5 

12 

24 

49 

72 

1483 

1640 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  = 

1588 

P  *  . 

2899 

P 

g 

.0183 

.0342 

.0598 

.0671 

.1105 

REEP  With 
Zero  Degree  of 
Freedom  in 
Category  5 


\ 


Group 

1 

2 

Actual 
.  3 

4 

_ 5_ 

Total 

1 

0 

0 

0 

0 

0 

0 

2 

3 

11 

12 

3 

4 

33 

3 

5 

18 

28 

10 

6 

67 

4 

5 

5 

21 

13 

8 

52 

5 

28 

45 

86 

132 

1 601 

1892 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  = 

1653 

P  =  . 

2638 

P 

g 

.0181 

.0325 

.0546 

.0667 

.0920 
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Comparison  Between  Persistence,  REEP  with  Zero  Degrees 
of  Freedom  in  Category  5.  REEP  with  the  Regular  Degrees 
of  Freedom  in  All  Categories  (See  Experiment  No.  1 ) 

Atlantic  City  -  Independent  Sample 


Hits 


P  Score 


Ceilir 


3 -hr  Forecast 


Persistence 

REEP  -  Zero  degrees  freedom 
in  Category  5 

REEP  -  Regular  degrees  freedom 
in  all  categories 


1702 

1725 

1728* 


Persistence  .2385 

REEP  -  Zero  degrees  freedom 

in  Category  5  .2131* 

REEP  -  Regular  degrees  freedom 

in  all  categories  .2135 


Ceiling:  7-hr  Forecast 


Persistence  1588 

REEP  -  Zero  degrees  freedom 
Hits  in  Category  5  1653 

REEP  -  Regular  degrees  freedom 

in  all  categories  1665* 

Persistence  .2899 

_  REEP  -  Zero  degrees  freedom 

P  Score  in  Category  5  .2638 

REEP  -  Regular  degrees  freedom 

in  all  categories  .2600* 


♦Asterisks  are  used  to  denote  superiority 


EXPERIMENT  4.  Ceiling  Prediction  Usir^  Persistence  with  One  and  Two 
Hour  Lagged  Persistence* 


Purpose 

A  test  on  the  predictability  of  persistence  when  tine  variations 
in  persistence  are  made  available. 

Predict ands 

Pre  dicta  rids  chosen  for  this  experiment  were  ceilings  at  1,  2,  and 
3  hours  in  advance.  The  operationally  significant  categories  for  which 
the  forecasts  were  made  are  shown  in  Table  4-1  •  The  specifications  for 
the  predictands  are  shown  in  Table  4-2. 

Predictors 

All  the  possible  combinations  of  the  five  categories  of  ceiling 
for  Atlantic  City  at  the  three  time  periods:  1 )  time  of  observation* 

2)  time  of  observation  minus  one  hour*  and  3)  time  of  observation 
minus  two  hours,  were  used  in  combinations  of  logical  "ANDS"  and  logical 
"CRSB  to  form  400  predictors.  These  400  predictors  plus  the  15  ceiling 
dummies  for  the  three  different  time  periods  gave  a  total  of  4*5  pre¬ 
dictors,  made  up  only  of  ceiling  dummies  for  only  one  station— Atlantic 
City.  The  intervals  for  the  five  categories  of  ceiling  used  as  pre¬ 
dictors  are  the  3aae  as  those  for  the  predictands  shown  in  Table  4-1  • 
Data  Sample 

Standard  hourly  airways  surface  observations  covering  the  ten  year 
period,  1  January  1949  to  31  December  1958,  furnished  the  data  for  this 
study.  The  developmental  sample  of  7956  observations  is  a  randan  se¬ 
lection  from  the  first  eight  years  and  the  verification  sample  of  2044 
observations  is  a  random  selection  from  the  last  two  years.  Note:  This 
sample  is  not  the  same  as  in  previous  experiments  because  lagged  pre¬ 
dictors  were  involved. 
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Results 


The  predictors  selected  by  ncEF  for  each  of  the  three  prcdict&nds 
are  given  in  Tables  4 -3a  to  4-3c.  Also  shown  are  the  HEEP  regression 
equation  coefficients  for  each  group  of  the  predictand. 

Contingency  tables  shewing  the  forecast-versus-observed  frequencies 
for  each  of  the  three  forecasts,  and  comparing  the  results  using  REEP 
to  the  results  using  persistence  (without  lags)  is  shown  in  Tables  4-4a 
to  4“4c«  The  number  of  correct  forecasts  (hits)  and  the  Brier  and  Allen 
P  scores  as  well  as  the  individual  group  contributions  to  the  overall  P 
score  are  shown  below  each  contingency  table.  The  number  of  hits  and 
the  overall  P  scores  are  suimrarized  in  Table  4-5. 

Conclusions 

The  41 5  possible  predictors  exhaust  the  ways  in  which  persistence 
with  lags  could  improve  the  forecast.  Contrary  to  common  belief  the 
results  of  this  experiment  show  there  is  little  improvement  over  per¬ 
sistence  when  lagged  persistence  is  made  available  for  selection. 
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Tahiti  4**^ 


Definition  of  rreaic  x^na  groups 


n  wax*»»w. 


v>+4  a  City  Municipal 


Airoort 


Group 

Kuafeer  Ceiling  Intervals 

1  Oft  <  Ceiling  <  200  ft 

2  200  ft  <  Ceiling  <  500  ft 

3  500  ft  <  Ceiling  <  1000  ft 

4  1000  ft  <  Ceiling  <  3000  ft 

5  3000  ft  <  Ceiling 
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Table  4-2 


Specifications  of  Predict ands 
Atxantic  City  Municipal  Airport 


Predictand 


1 

2 

_ 2— 

Predictard  variable 

CIG 

CIG 

CIG 

Forecast  interval-hour s  (H) 

1 

2 

3 

Number  of  Groups  (G) 

5 

5 

*; 

✓ 

Observations  in  Group  1  (n^ ) 

125 

128 

133 

Observations  in  Group  2  (t^) 

273 

259 

272 

Observations  in  Group  3  (n^) 

403 

426 

418 

Observations  in  Group  (n^) 

655 

631 

620 

Observations  in  Group  5  (n^) 

6500 

6512 

6513 

Total  dependent  sample  size  (N) 

7956 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

2652 

2652 

2652 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

Number  of  available  predictors  (P) 

415 

415 

415 
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Table  A- 3a 


Selected  Predictors  and  REEP  Equations 
Atlantic  City  1  -hr  Gelling  Forecast  (?-xpcri®ent  4) 


Predictor  Selected  (see  note) 

Predictor  Ceiling  _ 

Category  at  tine:  Coefficients  of  the  REEP  Equations 


Order 

Sta. 

Elea. 

*0 

*-i 

t-2 

A1 

A2 

_  A3  .. 

\ 

A? 

1 

ACT 

CIG 

5 

.005 

-.011 

-.084 

-544 

.634 

2 

ACT 

CIG 

1 

.767 

.120 

-.073 

-.630 

-.184 

3 

ACT 

CIG 

2 

.124 

.526 

.049 

-.588 

—  .110 

4 

ACT 

CIG 

3 

.009 

.115 

.460 

-.478 

-.106 

5 

ACT 

CIG 

* 

5 

-.005 

-.006 

-.013 

-.094 

d  20 

6 

ACT 

CIG 

2 

*  2 

* 

2 

-.235 

.352 

-.154 

.010 

.027 

7 

ACT 

CIG 

3 

* 

2 

-.125 

.1 56 

.025 

-.047 

-.009 

8 

ACT 

CIG 

2 

* 

2 

.186 

-.165 

.065 

-.031 

-.054 

9 

ACT 

CIG 

2 

+ 

3 

-.008 

-.012 

.086 

-.017 

-.049 

Additive  Constant: 

.003 

.021 

.102 

.657 

.217 

Mote:  tQ  aeans  at  tine  of  observation. 

t_.j  leans  one  hour  before  tine  of  observation, 
t^  means  two  hours  before  time  of  observation. 

*  means  logical  "AMD" 

+  means  logical  "(El" 

See  Table  4-1  for  limits  of  each  category  (group). 
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Table  4- 3b 


Selected  Predictors  and  REEP  Equations 
Atlantic  City  2-hr  Ceiling  Forecast  (Experiment  4) 


Predictor  Selected  (see  note) 

Predictor  Ceiling 

Category  at  time:  Coefficients  of  the  REEP  Equations 


Order 

Sta. 

Elem. 

_^2 

A. 

A2 

A? 

\ 

*5 

1 

ACT 

CIG 

5 

.001 

-.024 

-.071 

-.380 

.475 

2 

ACY 

CIG 

1 

.545 

.189 

-.110 

-.471 

-.153 

3 

ACT 

CIG 

2 

.117 

.349 

.168 

-*41 1 

-.223 

4 

ACY 

CIG 

3 

.045 

.013 

.321 

-.238 

—  .141 

5 

ACY 

CIG 

5 

* 

5 

-.006 

-.016 

-.032 

-.138 

.192 

6 

ACY 

CIG 

1 

*  1 

* 

2 

.334 

-.058 

-.099 

-.051 

-.127 

7 

ACY 

CIG 

5 

*  2 

.339 

-.134 

-.037 

-.074 

-.094 

a 

ACY 

CIG 

3 

+  2 

-.013 

.118 

-.011 

-.086 

-.008 

9 

ACY 

CIG 

4 

*  5 

* 

2 

-.008 

-.044 

.185 

-.356 

.223 

10 

ACT 

CIG 

1 

+  3 

+ 

1 

-.021 

-  042 

.097 

-.019 

-.015 

Additive  Constant: 

.008 

.044 

.111 

.542 

.295 

Note:  tg  means  at  time  of  observation 

t_j  means  one  hour  before  time  of  observation 
t_2  means  two  hours  before  time  of  observation 
*  means  logical  "AND" 

+  means  logical  "GR" 

See  Table  4-1  for  limits  of  each  category  (group). 
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Table  4-3.C 


Selected  Predictors  and  KEEP  Equations 
Atlantic  Gity  3-hr  Ceiling  Forecast  (Experiment  4) 


Predictor  Selected  (see  note) 

Predictor  Ceiling 

Category  at  time:  Coefficients  of  the  KEEP  Equations 


Order 

Sta. 

Elem. 

l0 

t-1 

t’-2 

Ai 

A2 

_ *3_ 

\ 

A5 

t 

ACI 

CIG 

5 

.004 

-.018 

i 

• 

o 

53 

-.285 

.374 

2 

ACT 

CIG 

1 

*389 

.173 

-.006 

-.338 

-.217 

3 

ACT 

CIG 

2 

.111 

.346 

.167 

o 

CM 

• 

1 

-.304 

4 

ACT 

CIG 

3 

.008 

.105 

.308 

-.203 

-.219 

5 

ACT 

CIG 

5  * 

5 

-.016 

-.032 

-.049 

-.099 

.196 

6 

ACT 

CIG 

2 

*• 

1 

-.033 

-.246 

.045 

.186 

.048 

7 

ACT 

CIG 

.1  * 

2 

.175 

.026 

-.082 

-.066 

-.054 

Additive  Constant: 

.016 

.056 

.132 

.415 

.381 

Note:  tg  means  at  time  of  observation 

t_i  means  one  hour  before  time  of  observation 
means  two  hours  before  time  of  observation 
*  means  logical  "AND" 
means  logical  "CR’* 

See  Table  4-1  for  limits  of  each  category  (group). 
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Contingency  Tables  Showing  Fr-edietani-Versus- Actual  Groups 
for  Persistence  and  REEP  Forecast  Using  Persistence  with  One 
and  Two-Hour  Lagged  Persistence  of  Ceiling 

Atlantic  City  1-hr  Ceiling  (Verification  Sample) 


Group 


Actual 


Total 


1  32  7  2  0  3  44 


REEP  With  2 

2 

51 

14 

2 

4 

73 

Lagged  Persistence  3 

1 

15 

80 

22 

9 

127 

4 

0 

2 

15 

113 

35 

165 

5 

3 

5 

8 

33 

1586 

1635 

Total 

38 

80 

119 

170 

1637 

20/t4 

Hits  *  1862  P  *  .1458 
P  .0075  .0207  .0318  .0427  .0432 

IS 
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Table  4-4 b 


Contingency  Tables  Showing  Predict  ar^i-VercusActual  Groups 
for  Persistence  and  REEP  Forecast  Using  Persistence  With  One 
and  Two-Hour  Lagged  Persistence  of  Ceiling 


Atlantic  City  2-hr  Ceiling  (Verification  Sample) 


Persistence 


Actual 


Group 

1 

2 

3 

4 

5 

Total 

1 

24 

12 

4 

1 

3 

44 

2 

2 

41 

18 

4 

8 

73 

3 

2 

24. 

57 

33 

11 

127 

4 

1 

0 

21 

89 

54 

165 

5 

3 

7 

22 

47 

1556 

1635 

Total 

32 

84 

122 

174 

1632 

2044 

Hits  *  1767 

P  -  .2016 

P  • 

0095 

.0267 

.0436 

.0571 

.0647 

g 


Actual 

Group  _J _ 2 _  3 _ 4 _ 5-  Total 


1 

24 

12 

4 

1 

3 

44 

REEP  With 

2 

2 

32 

13 

3 

5 

55 

Lagged  Persistence 

3 

2 

33 

62 

34 

14 

145 

4 

1 

0 

14 

70 

41 

126 

5 

3 

7 

29 

66 

156o 

1674 

Total 

32 

84 

122 

174 

1632 

2044 

Hits  -  1757  P  -  .2009 

P  .0102  .0267  .0A29  .0572  .0639 

g 
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Table  4-4 c 


Contingency  Tables  Showing  Predi ctaiid— .Versus— Actual  Groups 
for  Persistence  and  REEP  Forecast  Using  Persistence  With  One 
and  Two-Hour  Lagged  Persistence  of  Ceiling 

Atlantic  City  3-hr  Ceiling  (Verification  Sample) 


Persistence 


Actual 


Group 

1 

2 

_ 3  . 

4 

.  ....  5_ 

Total 

1 

20 

13 

5 

1 

5 

44 

2 

6 

31 

20 

5 

11 

73 

3 

4 

26 

53 

32 

12 

127 

4 

1 

2 

28 

64 

70 

165 

5 

5 

11 

32 

61 

1526 

1635 

Total 

36 

83 

138 

163 

T624 

2044 

Hits  =  1694  P  =  .2392 

P  .0130  .0301  .0514  .0626  .0822 

g 


Actual 


Group 

1 

2 

3 

4 

5 

Total 

1 

20 

13 

5 

41 

1 

5 

44 

REEP  With 

2 

5 

26 

16 

5 

11 

63 

Lagged  Persistence 

3 

5 

31 

57 

32 

12 

137 

4 

1 

2 

22 

53 

56 

134 

•  9  *» 

5 

5 

11 

38 

72 

1540 

1666 

Total 

36 

83 

138 

163 

1624 

2044 

Hits  =  1696 

P  =  . 

2375 

P 

a 

.0132 

.0306 

.0512 

.0623 

.0802 
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Table  4-5 


Comparison  Between  Persistence  and  REEP 
with  Lagged  Persistence  of  Ceiling 


Ceiling:  1-hr  Forecast 

Persistence  1862 

REEP  with  Lagged 

Persistence  of  Ceiling  1862 


P  Score 


Persistence  .1469 

REEP  with  Lagged 

Persistence  of  Ceiling  .1458* 


Ceilirffi  2-hr  Forecast 

Persistence 
REEP  with  Lagged 

Persistence  of  Ceiling 


P  Score 


Persistence 
REEP  with  Lagged 

Persistence  of  Ceiling 


1767* 

1757 

.2016 

.2009* 


Hits 

P  Score 


Crf ling;  3-hr  Forecast 

Persistence 
REEP  with  Lagged 

Persist encs  of  Ceiling 

Persistence 
REEP  with  Lagged 

Persistence  of  Ceiling 


1694 

1696* 

.2392 

.2375* 


Asterisks  are  used  to  denote  superiority 


EXPERIMENT  5.  Multiple  Predictands  Processed  Simultaneously. 


Purpose 

To  investigate  the  selection  of  predictors  for  more  than  one  pre- 
dictand  at  a  time  in  an  attempt  to  reduce  the  number  of  analysis  runs 
ordinarily  required. 

Procedure 

Four  REEP  selection  runs  were  performed  using  the  following  pairs 
of  predictands  as  the  predictand: 

1)  Ceiling  plus  3  hours  and  visibility  plus  3  hours 

2)  Ceiling  plus  3  hours  and  ceiling  plus  7  hours 

3)  Visibility  plus  3  hours  and  visibility  plus  7  hours 

4)  Ceiling  plus  7  hours  and  visibility  plus  7  hours 

Predictors  consisted  of  dummy  (zero- one)  variables  of  seven  meteorological 
elements  from  a  thirteen-station  network  (see  Figure  1-1).  The  predictors 
selected  from  those  runs  were  compared  with  those  selected  when  the  pre¬ 
dictands  were  run  singly.  This  comparison  is  shown  in  Table  5-1  •  The 
predictors  selected  when  the  predictands  were  run  singly  are  indicated  by 
an  x  under  the  appropriate  ceiling  or  visibility  predictand. 

Predictands 

The  five  operationally  significant  categories  of  ceiling  and  visi¬ 
bility  for  the  predictands  are  shown  in  Table  5-2.  The  specifications 
of  the  predictands  are  listed  in  Table  5-3» 

Predictors 

The  423  predictors  used  in  this  experiment  are  the  same  as  those 
used  in  Foqse rimer t  No.  1  (see  Tables  1-3  and  1-4)» 
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Data  Sample 


Standard  hourly  airways  surface  observations  covering  the  ten  year 
period,  1  January  1949  to  31  December  1958,  constituted  the  data  used 
in  this  study.  The  developmental  sample  of  7956  observations  is  a 
random  selection  from  the  first  eight  years  and  the  verification  sample 
of  2044, observations  is  a  random  selection  from  the  last  two  years. 
Results 

Contingency  tables  (Tables  5-4a  and  5**4b)  were  formed  to  show  the 
forecast-versus-observed  frequencies  for  the  3-hr  predictions  of  ceiling 
and  visibility  using  the  predictors  selected  by  KEEP  when  the  predictand 
was  a  single  predictand  and  also  when  the  predictand  was  a  pair  of  pre¬ 
dicts  nds.  The  number  of  correct  forecasts  (hits)  and  the  Brier  and 
Allen  P  scores  as  well  as  the  individual  group  contributions  to  the 
overall  P  score  are  given  below  each  contingency  table. 

Conclusions 

There  is  sufficient  redundancy  in  the  predictands  such  that  se¬ 
lection  of  predictors  may  be  made  on  more  than  ouo  predictand  at  a 
time.  This  applies  even  though  they  differ  with  regard  to  meteoro¬ 
logical  element  or  with  regard  to  time  leads.  These  conclusions 
were  drawn  from  the  fact  that  the  predictors  selected,  when  the  pre¬ 
dictands  were  processed  singly,  are  all  essentially  among  those 
selected  when  they  are  considered  jointly.  The  one  direct  comparison 
for  which  results  on  independent  data  were  obtained  (Ceiling  3  hrs 
ami  Visibility  3  brs)  confirms  this  surmise. 
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Table  5-1 

Predictors  Selected  When  the  Predictand  is  a  Set 

(Columns  at  left  of  each  list  show  thoee  predictors  also  selected  when  selection  was  run  singly  for  the 
indicated  predictand.)  c 
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MDT  VIS-2 
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Table  5-3 


Specification  of  Predictands 
Atlantic  City  Municipal  Airport 


Predictand 


1 

2 

Predictand  variable 

CIG 

VIS 

Forecast  interval — hours  (H) 

3 

3 

Humber  of  Groups  (G) 

5 

5 

Observations  in  Group  1  (n^ ) 

100 

153 

Observations  in  Group  2  (n^) 

281 

125 

Observations  in  Group  3  (n^) 

385 

200 

Observations  in  Group  4  (n^) 

660 

286 

Observations  in  Group  5  (n^) 

6530 

7192 

Total  dependent  sample  size  (N) 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

2652 

2652 

Total  independent  sample  size  (M) 

2044 

2044 

Number  of  available  predictors  (P) 

423 

423 
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Table  5 -4a 


Contingency  Tables  Showing  Predict  ed*-Versus- Actual  Groups 
Using  Predictors  Selected  when  the  Predict  and  was  a  Single 
Predictand  and  Using  Predictors  Selected  when  the  Predict and 

was  a .Pair  of  Predictands 

Atlantic  City  3-hr  Ceiling  (Independent  Sample) 


Actual 


Using  Predictors  Selected 
When  Predictand  was  Single 


Group 

i 

2 

3 

. .  4  _ 

5 

Total 

1 

6 

4 

1 

0 

1 

12 

2 

19 

34 

25 

8 

4 

90 

3 

0 

11 

42 

14 

5 

72 

4 

1 

6 

19 

41 

20 

87 

5 

18 

18 

40 

102 

1605 

1783 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  »  1728 

P  -  .2135 

K  • 

0163 

.0277 

.0423 

.0605 

•0666 

Actual 


Using  Predictors  Selected 
When  Predictand  was  a  Pair 


Group 

1 

2 

3 

4 

5 

Total 

1 

6 

3 

1 

0 

2 

12 

2 

19 

35 

25 

8 

4 

91 

3 

0 

13 

40 

14 

5 

72 

4 

1 

7 

19 

41 

22 

90 

5 

18 

15 

42 

102 

1602 

1779 

Total 

44 

73 

127 

165 

1635 

2044 

Hits 

-  1724 

P  *  . 

2133 

P 

O 

.0165  . 

0279 

.0421 

.0605 

.0663 
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Table  5 -4b 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
Using  Predictors  Selected  when  the  Predictand  was  a  Single 


n„.Ji  -i.  ~  ?!=?■*  AWfl  QaI  oaf  oH  U^art  4'Vl  o 

«VAXW  w  V  A  w  h/VA  w  v  w  *»  naiwa*  v«»  w  —  «.  — - v  W - .  I . 


rreuxuwiiu  atu  vai.115  h«uj.i 


was  a  Pair  of  Predictands 


Atlantic  City  3-hr  Visibility  (Independent  Sample) 


Group 

1 

Using  Predictors  Selected  2 

When  Predictand  was  Single  3 

4 

5 

Total 


Actual 


1 

2 

3 

4 

5 

Totcvl 

13 

9 

5 

1 

4 

32 

2 

5 

4 

0 

9 

20 

0 

2 

0 

0 

0 

2 

0 

0 

3 

4 

0 

7 

27 

30 

66 

88 

1772 

1983 

42 

46 

78 

93 

1785 

2044 

Hits  »  1794  P  -  .1800 
Pg  .0169  .0199  .0331  .0395  .0707 


Using  Predictors  Selected 
When  Predictand  was  a  Pair 


Actual 


Group 

1 

2 

3 

4 

5 

Total 

1 

10 

7 

4 

0 

3 

24 

2 

3 

4 

4 

0 

6 

17 

3 

0 

3 

0 

0 

0 

3 

4 

0 

0 

0 

2 

1 

3 

5 

29 

32 

70 

91 

1775 

1997 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  *  1791 

P  *  .1803 

0167 

.0199 

.0334 

.0395 

.0708 
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EXPERIMENT  6.  Errect  of  Restricting  Selection  to  Predictors  with 
Certain  Minimum  Occurrence  Frequencies. 

Purpose 

This  experiment  was  conducted  to  determine  in  a  general  way  if 
there  was  any  optimum  limit  to  the  number  of  occurrences  to  be  per¬ 
mitted  in  a  predictor  before  REEP  would  be  allowed  to  include  that 
predictor  among  those  selected. 

Procedure 

Forecasts  were  made  for  3“hr  and  7-hr  ceiling  and  visibility  at 
Atlantic  City  Airport.  Three  different  minimum  number  of  occurrences 
of  the  predictors  were  specified  in  the  separate  runs,  except  for 
ceiling  three  hours  in  advance,  which  was  tested  for  only  two.  The 
number  of  occurrences  of  the  predictors  specified  were  10,  50,  and 
100.  In  the  first  case  any  predictor  must  have  occurred  at  least  ten 
times  before  it  could  be  considered  by  REEP  for  selection,  and  similarly 
for  the  cases  of  50  and  100.  The  forecasts  made  using  the  predictors 
selected  by  REEP  in  each  case  were  then  compared  to  determine  the  most 
favorable  minimum  occurrence  frequency,  comparing  the  P  score  and  the 
number  of  correct  forecasts  in  each  case. 

Data  Sample 

The  developmental  sample  of  7956  observations  is  a  random  selection 
of  hourly  surface  observations  from  the  eight  year  period  from  1  January 
1949  to  31  December  1956.  The  verification  sample  of  2044  observations 
is  a  random  selection  from  the  two  year  period  from  1  January  1957  to 
31  December  1953.  Observations  are  included  in  this  sample  for  the  13 
stations  comprising  this  Atlantic  City  Airport  network  (Figure  1-1). 
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Predictands 


Table  6-1  shows  the  five  operationally  significant  categories  of 
ceiling  and  visibility  for  the  predictands  used  in  this  experiment. 

The  specifications  of  the  predictands  are  shown  in  Table  6-2. 

Predictors 

The  423  original  dummy  predictors  used  in  this  experiment  are  the 
same  as  those  used  in  Experiment  No.  1  (see  Tables  1-3  and  1-4).  The 
predictors  with  number  of  occurrences  less  than  100  are  listed  in  Table 
6-3*  There  are  90  such  dummy  predictors  out  of  a  total  of  423*  The 
number  of  observations  in  the  developmental  sample ,  as  noted  previously v 
is  7956. 

Results 

Contingency  tables  (Tables  6-4a  to  6-4d)  were  formed  to  show  the 
forecast- versus -observed  frequencies  for  the  3“hr  and  7-hr  predictions 
of  ceiling  and  visibility  using  the  predictors  selected  by  REEP  when  the 
conditions  of  10,  50,  and  100  occurrence  minimum  were  applied  to  the 
selection  procedure.  The  number  of  correct  forecasts  (hits)  and  the 
Brier  and  Allen  P  scores  as  well  as  the  individual  group  contributions 
to  the  overall  P  score  are  given  below  each  contingency  table.  The 
number  of  hits  and  the  overall  P  scores  are  summarized  in  Table  6-5. 
Conclusions 

The  results  suggest  that,  when  selection  is  restricted  to  pre¬ 
dictors  with  a  larger  number  of  occurrences,  the  predictors  are  as 
good  or  better  than  those  when  restricted  by  fewer  number  of  occur¬ 
rences.  In  addition,  there  is  no  apparent  deterioration  in  the  ability 
to  forecast  low  conditions  by  this  restriction. 
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Table  6-1 


Definition  of  Predictand  Groups  for  Atlantic  City  Municipal  Airport 


Group 

Number 

Ceiling  Intervals 

1 

0  f t  <  Ceiling  <  200  ft 

2 

200  ft  <  Ceiling  <  500  ft 

3 

500  ft  <  Ceiling  <  1000  ft 

'  4 

1000  ft  <  Ceiling  <  3000  ft 

5 

3000  ft  <  Ceiling 

Group 

Number 

Visibility  Intervals 

1 

0  mi  <  Visibility  <  1/2  mi 

2 

1/2  mi  <  Visibility  <  1  mi 

3 

1  mi  <  Visibility  <  2  mi 

4 

2  mi  <  Visibility  <  3  mi 

5 

3  mi  <  Visibility 
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Table  6-2 


Specification  of  Predictands 
Atlantic  City  Municipal  Airport 


Predicta nd 


1 

2 

. 3.  „ 

_ 

Predictand  variable 

CIG 

CIG 

VIS 

VIS 

Forecast  interval — hours  (II) 

3 

7 

3 

7 

Number  of  Groups  (G) 

5 

5 

5 

5 

Observations  in  Group  1  (n^ ) 

100 

135 

153 

167 

Observations  in  Group  2  (i^) 

2  ei 

272 

125 

130 

Observations  in  Group  3  (n^) 

335 

420 

200 

230 

Observations  in  Group  4  (n^) 

660 

619 

286 

283 

Observations  in  Group  5  (n^) 

6530 

6510 

7192 

7146 

Total  dependent  sample  size  (N) 

7956 

7956 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

Group  1 

5500 

5500 

5500 

5500 

Group  2 

5500 

5500 

5500 

5500 

Group  3 

5500 

5500 

5500 

5500 

Group  4 

5500 

5500 

5500 

5500 

Group  5 

3000 

3000 

3000 

3000 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

2044 

Number  of  available  predictors  (P) 

(423) 

(423) 

(423) 

(423) 

10  Occurrence  Criteria 

403 

403 

403 

403 

50  Occurrence  Criteria 

371 

371 

371 

371 

100  Occurrence  Criteria 

333 

333 

333 

333 
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Predictor 

NEL  WEA  5 
NEL  WEA  6 
NEL  WEA  7 
NEL  WEA  8 
NEL  WEA  11 

PHL  CIG  1 
PHL  VIS  1 
PHL  VIS  2 
PHL  WEA  4 
PHL  WEA  5 
PHL  WEA  6 
PHL  WEA  7 
PHL  WEA  8 
PHL  WEA  11 

SET  CIG  1 
SBI  VIS  2 
SBI  WEA  5 
SBI  WEA  6 
SET  WEA  7 
SBI  WEA  8 
SET  WEA  11 

MDT  CIG  1 
®T  CIG  2 
MDT  VIS  1 
MDT  WEA  4 
MDT  WEA  5 
MDT  WEA  6 
MDT  WEA  7 
MDT  WEA  8 
MDT  WEA  V 


Table  6-3 

Predictor s  in  Developmental  Semple  (7956  Observations) 
with  Number  of  Occurrences  Less  Than  100 

Predictors  in  dummy  (iero-one)  form 


Number  of 
Occurrences 


46 

11 

43 

2 

5 

42 

68 

59 

41 

»  L 


25 

5 

1 

71 
91 
36 

3 

60 

5 

1 

51 

90 

74 

72 
80 
17 
28 
13 

2 


Predictor 

ACT  CIG  (1) 
ACT  CIG  (2) 
ACT  CIG  (3) 
ACT  CIG  (4) 
ACT  VIS  (1) 
ACT  VIS  (2) 
ACT  VIS  (3) 
ACT  VIS  (5) 
ACT  WEA  5 
ACT  WEA  6 
ACT  WEA  7 
ACT  WEA  8 
ACT  WEA  11 

DCA  CIG  1 
DCA  CIG  2 
DCA  VIS  1 
DCA  VIS  2 
DCA  WEA  4 
DCA  WEA  5 
DCA  WEA  6 
DCA  WEA  7 
DCA  VEA  8 
DCA  WEA  11 

ORF  CIG  1 
ORF  VIS  1 
ORF  VIS  2 

PSB  WEA  7 
PSB  WEA  8 
PSB  WEA  11 


Number  of 
Occurrences 


53 

64 

98 
62 

46 
52 
63 

99 

42 
3 

36 

3 

5 

19 

81 

29 

16 

77 

45 

7 

50 

11 

0 

47 
67 
41 

67 

43 
45 


Predictor 

BGM  VIS  2 
BGM  WEA  4 
BGM  WEA  7 
BGM  WEA  8 
BGM  WEA  11 

SWF  CIG  1 
SWF  WEA  6 
SWF  WEA  7 
SWF  WEA  8 
SWF  WEA  11 

RIC  CIG  1 
RIC  VIS  1 
RIC  VIS  2 
RIC  WEA  5 
RIC  WEA  6 
RIC  WEA  7 
RIC  WEA  8 
RIC  WEA  11 

IDL  CIG  1 
IDL  VIS  1 
IDL  VIS  2 
IDL  WEA  5 
IDL  WEA  6 
IDL  WEA  7 
IDL  WEA  8 
IDL  WEA  11 

DSM  WEA  4 
DSM  WEA  6 
DSM  WEA  8 
DSM  WEA  10 
DSM  WEA  11 


Number  of 
Occurrences 

97 

84 

58 

37 
52 

81 

21 

56 

26 

8 

74 

91 

66 

38 

5 

52 

8 

0 

76 

90 

69 
64 
11 
37 

9 

6 

99 

40 

23 

70 

24 


100 


I 


Table  6-4a 


Contingency  Tables  Showing  Predioted-Versuo-Actual  Groups 
When  Selection  of  Predictors  is  Limited  to  Those  With  A 
Specified  Minimum  Occurrence  Frequency 

Atlantic  City  3-hour  Ceiling  (Independent  Sample) 


Actual 

Group 

1 

2 

3  __  4 

5 

Total 

1 

5 

4 

2  0 

2 

13 

REEP  with  Selection 

2 

19 

33 

23  6 

3 

84 

of  Predictors  Limited 

3 

1 

11 

39  12 

9 

72 

to  tO-Occurrence  Minimum 

4 

0 

7 

22  43 

21 

93 

5 

19 

18 

41  104 

1600 

1782 

Total 

44 

73 

127  165 

1635 

2044 

Hits  =■  1720  P  -  .2131 

P 

g 

.0165 

.0278 

.0433  .0592 

.0663 

Actual 

Group 

1 

2 

_ 3 _ 4 

5 

Total 

REEP  with  Selection 

1 

2 

(Prediction  not  made 

for 

of  Predictors  Limited 

3 

to  50-Occurrence  Minimum 

4 

5 

3-hr  Ceiling) 

Total 

Hits  = 

P  «= 

P 

g 

Actual 

Group 

1 

2 

3  . 4  _ 

5 

Total 

1 

10 

5 

2  0 

3 

20 

REEP  with  Selection 

2 

18 

30 

25  6 

2 

81 

of  Predictors  Limited 

3 

0 

13 

41  12 

8 

74 

to  100-0ccurrence  Minimum 

4 

0 

7 

20  46 

18 

91 

«; 

A 

16 

18 

39  101 

1604 

1778 

Total 

44 

73 

127  165 

163.5 

2044 

Hits  =  1731  P  =  .21 

10 

P 

g 

.0161 

.0272 

.0429  .0592 

.0656 
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Table  6— Ab 


Contingency  Tables  Slowing  Predict ed-Versus- Actual  Groups 
When  Selection  of  Predictors  is  limited  to  Those  With  A 
Specified  Minimum  Occurrence  Frequency 

Atlantic  City  7-hour  Ceiling  (Independent  Sample) 


Actual 

Group 

1 

2 

_ 

_ 4- 

_ I. 

Total 

1 

0 

0 

0 

0 

0 

0 

REEP  with  Selection 

2 

9 

17 

7 

3 

2 

38 

of  Predictors  Limited 

3 

3 

15 

32 

10 

6 

66 

to  10-Occurrence  Minimum 

4 

5 

8 

19 

16 

7 

55 

5 

24 

39 

89 

129 

1604 

1885 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  -  1669 

P  -  . 

2567 

P 

g 

.0177 

.0325 

.0539 

.0658 

.0868 

Actual 

Group 

1 

2 

3  ... 

4 

5 

Total 

1 

0 

0 

0 

0 

0 

0 

REEP  with  Selection 

2 

7 

17 

8 

3 

3 

38 

of  Predictors  limited 

3 

6 

16 

34 

11 

7 

74 

to  50-Occurrence  Minimum 

4 

5 

6 

18 

13 

8 

50 

5 

23 

40 

87 

131 

1601 

1882 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  =  1665 

P  - 

2567 

V 

.0177 

.0325 

.0540 

.0660 

.0866 

Actual 

Group 

1 

2 

-3 

4 

_  5 

Total 

1 

0 

0 

0 

0 

0 

0 

REEP  with  Selection 

2 

9 

16 

10 

5 

2 

42 

of  Predictors  Limited 

3 

5 

16 

33 

10 

6 

70 

to  100-0ccurrence  Minimi** 

4 

5 

5 

19 

16 

6 

51 

5 

22 

42 

85 

127 

1605 

1881 

Total 

.  41 

79 

147 

158 

1619 

2044 

Hits  »  1 670 

P  =  . 

2572 

P 

g 

.0178 

.0326 

.0538 

.0662 

.0868 

102 


Table  6-4 c 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups 
When  Selection  of  Predictors  is  Limited  to  Those  With  A 
Specified  Minimum  Occurrence  Frequency 

Atlantic  City  3-hour  Visibility  (Independent  Sample) 


Group 

J _ 

*  2 

Actual 

3 

4 

5 

Total 

1 

11 

6 

3 

0 

5 

25 

R£EP  with  Selection 
of  Predictors  Limited 
to  10~0ccurrence  Minimum 

2 

3 

4 

5 

Total 

pg  • 

Group 

3  6  7 

1  3  0 

0  0  0 

27  31  68 

42  46  73 

Hits  =*  1794 

0166  .0197  .0328 

Actual 

1  2  3 

0  5 

0  3 

6  1 

87  1771 

93  1785 

P  »  .1799 

.0393  .0715 

_ 4 _ 5 

21 

7 

7 

1984 

2044 

Total 

1 

11 

8 

5 

0 

3 

27 

BEEP  with  Selection 

2 

1 

4 

5 

0 

6 

16 

of  Predictors  Limited 

3 

1 

3 

0 

0 

1 

5 

to  50-Occurrence  Minimum 

4 

1 

0 

1 

6 

1 

9 

5 

28 

31 

67 

87 

1774 

1987 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  «  1795 

P  »  .1793 

pg  • 

0168 

.0199 

.0327 

.0392 

.0707 

Actual 

Group 

1 

2 

3 

4 

5 

Total 

1 

19 

11 

7 

0 

6 

43 

REEP  with  Selection 

2 

1 

4 

1 

0 

7 

13 

of  Predictors  Limited 

3 

0 

1 

0 

0 

0 

1 

to  100- Occurrence  Minimum 

4 

1 

0 

0 

6 

0 

7 

5 

21 

30 

70 

87 

1772 

1980 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  -  1801 

P  -  .1 

1799 

Pg  • 

0169 

.0201 

.0332 

.0393 

.0705 
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Table  6-4d 


Contingency  Tables  Slowing  Predicted-Versus-Actual  Groups 
When  Selection  of  Predictors  is  Limited  to  Those  With  A 
Specified  Minimum  Occurrence  Frequency 

Atlantic  City  7-hour  Visibility  (Independent  Sample) 


Actual 

Group  _1 _ 2  3 _ 4 _ 5-  Total 


1 

0 

0 

0 

1 

1 

BEEP  with  Selection 

2 

1 

0 

0 

0 

0 

of  Predictors  limited 

3 

1 

0 

0 

0 

0 

to  10-Gccurrence  Minimum 

4 

0 

0 

0 

0 

0 

5 

41 

38 

90 

98 

1773 

Total 

43 

38 

90 

99 

1774 

Hits 

-  1773 

P  »  . 

2161 

P 

g 

.0195  .( 

0181 

.0404 

.0447 

.0934 

Actual 

Group 

1 

2 

_ 2__ 

_ k. 

_JL 

1 

0 

0 

0 

1 

1 

BEEP  with  Selection 

2 

1 

0 

0 

0 

0 

of  Predictors  Limited 

3 

1 

0 

0 

0 

0 

to  50-0ccurrence  Minimi* 

4 

0 

0 

0 

0 

0 

5 

41 

38 

90 

98 

1773 

Total 

43 

38 

90 

99 

1774 

Hits 

=  1773 

P  -  . 

2162 

P 

g 

.0195  .< 

3180 

.0404 

.0447 

.0935 

Actual 

Group 

1 

2 

3  _ 

-  4 

_  5 

1 

0 

0 

1 

0 

1 

BEEP  with  Selection 

2 

0 

0 

0 

0 

0 

of  Predictors  Limited 

3 

0 

0 

0 

0 

0 

to  100-0ccurrence  Minimi* 

4 

0 

0 

0 

0 

0 

5 

43 

38 

89 

99 

1773 

Total 

43 

38 

90 

99 

1774 

Hits 

=  1773 

P  -  . 

2144 

? 

g 

.0193  .< 

3180 

.0401 

.0447 

.0923 

2 

1 

1 

0 

2040 

2044 


Total 


2 

1 

1 

0 

2040 

2044 


Total 


2042 

2044 
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Table  6-5 


i 


n _ _  —4 

mjtya*  xovji 


T*}  n'f  i  i  n  ji  to 
iA/vn^vii  *  4 


■as)  4  /»+  ^  a«c 

VU4.»‘  WAV*  ^ 


Morlii  UVa  n  QaT  a  At  or> 


lltlV** 


Prsdi^tcrs 


is  Limited  to  a  Minimum  Occurrence  Frequency  of  10,  50,  and  100. 


ACY  Ceiling  -  3-hr  Forecast 


10  Occurrence  Minimum 

1720 

Hits 

50  Occurrence  Minimum 

— 

100  Occurrence  Minimum 

1731* 

>0  Occurrence  Minimum 

.2131 

P  Score 

50  Occurrence  Minimum 

100  Occurrence  Minimum 

.2110* 

ACY  Ceiling  -  7-hr  Forecast 


10  Occurrence  Minimum 

1669 

Hite 

50  Occurrence  Minimum 

1665 

100  Occurrence  Minimum 

1670* 

10  Occurrence  Minimum 

.2567* 

P  Score 

50  Occurrence  Minimum 

.2567* 

100  Occurrence  Minimum 

.2572 

ACY  Visibility  -  3-hr  Forecast 


10  Occurrence  Minimum 

1794 

Hits 

50  Occurrence  Minimum 

1795 

100  Occurrence  Minimum 

1001* 

10  Occurrence  Minimum 

.1799 

P  Score 

50  Occurrence  Minimum 

.1793* 

100  Occurrence  Minimum 

.1799 

ACY  Visibility  -  7-hr  Forecast 


10  Occurrence  Minimum 

1773 

Hits 

50  Occurrence  Minimum 

1773 

100  Occurrence  Minimum 

1773 

10  Occurrence  Minimum 

.2161 

P  Score 

50  Occurrence  Minimum 

.2162 

100  Occurrence  Minimum 

.2144' 

Asterisks  are  used  to  denote  superiority. 
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EXPERIMENT  7.  Single-Station  Predictors:  Raw  Dunmies  and  Boolean 
Combinations* 


Purpose 

To  investigate  the  accuracy  of  forecasts  using  only  singLe-station 
predictors.  In  the  event  the  accuracy  is  sufficiently  competitive,  a 
generalized  operator  might  be  developed  where  spacial  analyses  of  network 
parameters  would  not  be  required. 

Procedure 

From  the  423  predictors  used  in  the  Atlantic  City  network  of  13 
stations  (see  Table  1-3),  the  55  predictors  for  only  Atlantic  City  pre¬ 
dictors  (not  including  TOD  and  DOT)  were  extracted.  Selections  and  pre¬ 
dictions  were  first  made  for  ACT  ceiling  and  visibility  for  three  and 
seven  hours  using  the  55  dummy  predictors  alone. 

Next,  those  dummy  predictors  with  400  or  more  occurrences  were  then 
formed  into  all  possible  combinations  of  pairs  joined  by  a  logical  '‘AND" 
including  the  combination  of  each  predictor  with  itself.  An  exception  to 
this  procedure  was  made  in  figuring  the  number  of  occurrences  under  the 
Weather  Element  heading.  In  this  case  the  weather  dummies  from  2  to  8 
(precipitation)  were  grouped  together  to  represent  a  precipitation  pre¬ 
dictor.  Combining  the  dummy  predictors  in  this  way  resulted  in  the  forma¬ 
tion  of  467  new  predictors.  Selections  and  predictions  were  again  made 
for  ACT  ceiling  and  visibility  at  three  and  seven  hours  in  advance  using 
the  467  Boolean-paired  predictors.  The  results  were  compared  with  those 
from  the  prediction  runs  with  the  raw  dummy  predictors,  as  well  as  with 
the  results  using  all  the  network  predictors  (Experiment  No.  1). 
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rrediciantig 

The  predictands,  as  used  in  the  earlier  experiments,  are  subdivided 
into  five  operationally  significant  intervals  of  ceiling  and  visibility 
as  shown  in  Table  7-1 ♦  The  specifications  of  the  predictands  are  shown 
in  Tables  7- 2a  and  7-2b. 

Predictors 

As  noted  previously  the  predictors  used  ir  this  experiment  were 
extracted  from  the  423  predictors  used  in  the  Atlantic  City  network  of 
13  stations.  The  55  dummy  predictors  used  in  the  first  prediction  runs 
are  shown  in  Table  7-3  together  with  the  number  of  occurrences  of  each 
in  the  developmental  sample  of  7956  observations.  Table  7-3  also  lists 
the  specifications  and  limits  of  the  dummy  variables.  Those  predictors 
with  400  occurrences  or  more,  plus  the  time  of  day  (TOD)  and  day  of 
year  (DOY),  were  formed  into  all  possible  pairs  joined  fcy  a  logical  "AND" 
resulting  in  467  Boolean- paired  predictors. 

Data  Sample 

As  in  the  earlier  experiments  the  10,000  observations  used  in  this 
experiment  were  randomly  selected  from  the  ten  year  period  1  January 
1949  to  31  December  1958.  The  developmental  sample  has  7956  observations 
from  the  first  eight  years  of  the  ten  year  period,  and  the  verification 
sample  has  2044  observations  from  the  last  two  years. 

Results 

The  four  sets  of  predictors  selected  by  REEP,  using  the  55  predic¬ 
tors  for  ACT  are  listed  in  Tables  7-4a  to  7-4d.  The  predictors  selected 
using  the  467  Boole  an- paired  predictors  are  shown  in  Tables  7- 5a  to 
7-5d.  Also  shewn  in  each  of  these  tables  are  coefficients  in  the  REEP 
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regression  equation  for  each  group  of  the  predictand.  Contingency  tables 
(Tables  7-6a  to  7-6d)  show  the  forecast-versus-observed  frequencies  for 
the  3-hr  and  7-hr  predictions  of  ceiling  and  visibility  using  the  55  dummy 
predictors  fcr  ACY  listed  in  Table  7-3  and  also  using  the  467  Boolean  com¬ 
bination  of  predictors  previously  described.  The  number  of  correct  fore¬ 
casts  (hits)  and  the  Brier  and  Allen  P  scores  as  well  as  the  individual 
group  contributions  to  the  overall  P  score  are  given  below  each  contin¬ 
gency  table.  Tables  7-7a  and  7-7b  summarize  the  hits  and  P  scores  for 
this  experiment.  In  addition,  these  tables  show  how  the  results  of  this 
experiment  compare  with  those  of  Experiment  No.  1,  in  which  all  the  dummy 
predictors  for  the  13  station  Atlantic  City  network  were  used,  and  with 
the  results  of  a  straight  persistence  forecast. 

Conclusions 

1 )  The  single-station  raw  dummy  predictors  give  results  which  are 
better  than  persistence, 

2)  'f*  ?  single-station  Boolean  predictors  are  as  good  or  better 
than  the  raw  predictors  except  for  the  P  score  In  predicting  3-hr  ceiling. 
Low  conditions  are  forecast  more  often  and  more  accurately  with  Boolean 
predictors. 

3)  Although  the  selected  network  predictors  are  quite  a  bit  better 
than  either  single-station  set  of  predictors,  the  Boolean  set  is  con¬ 
sistently  better  than  the  network  in  predicting  visibility. 

4)  The  results  are  sufficiently  encouraging  to  suggest  that  more 
work  be  done.  In  addition,  it  seems  worth  attempting  to  combine  the  set 
of  network  and  Boolean  predictors  in  a  separate  experiment  (see  Experiment 
No.  8). 
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Table  7-1 


Definition  of  Predictand  Groups  for  Atlantic  City  Municipal  Airport 


Group 

Number  Ceiling  Intervals 


1 

0 

ft 

< 

Ceiling  <  200  ft 

2 

200 

ft 

< 

Ceiling  <  500  ft 

3 

500 

ft 

< 

Ceiling  <  1000  ft 

4> 

1000 

ft 

< 

Ceiling  <  3000  ft 

5 

3000 

ft 

s 

Ceiling 

Group 

Number 

Visibility  Intervals 

1 

0 

mi 

< 

Visibility  <  1/2  mi 

2 

1/2 

mi 

< 

Visibility  <  1  mi 

3 

1 

mi 

< 

Visibility  <  2  mi 

U 

2 

mi 

< 

Visibility  <  3  ai 

5 

3 

mi 

< 

Visibility 

10  9 


Table  7- 2a 

Specification  of  Predictands  -  Atlantic  City  Municipal  Airport 
(As  used  in  prediction  runs  using  raw  predictors) 


Predictand 


1 

2 

_ 

4, 

Predictand  variable 

GIG 

CIG 

VIS 

VIS 

Forecast  interval — hours  (H) 

3 

7 

3 

7 

Number  of  Groups  (G) 

5 

5 

5 

5 

Observations  in  Group  J  (n^ ) 

100 

135 

153 

167 

Observations  in  Group  2  (n^) 

261 

272 

125 

130 

Observations  in  Group  3  (n^) 

385 

420 

200 

230 

Observations  in  Group  4  (n^) 

660 

619 

286 

283 

Observations  in  Group  5  (n^) 

6530 

6510 

7192 

7146 

Total  dependent  sample  size  (N) 

7956 

7956 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

7956 

7956 

7956 

7956 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

2044 

Number  of  available  predictors  (P) 

55 

55 

55 

55 

i 

i 

i 

i 
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Specification  of  Predictands  -  Atlantic  City  Municipal  Airport 
(As  used  in  prediction  runs  using  Boolean  predictors) 


Predictand 


_  1 _ 

2 

_ 2— 

4 

Predictand  variable 

CIO 

CIG 

VIS 

VIS 

Forecast  interval — hours  (H) 

3 

7 

3 

7 

Number  of  Groups  (G) 

5 

5 

5 

5 

Observations  in  Group  1  (n^ ) 

100 

135 

153 

167 

Observations  in  Group  2  (r^) 

281 

272 

125 

130 

Observations  in  Group  3  (n^) 

385 

420 

200 

230 

Observations  in  Group  4  (n.  ) 

4 

660 

619 

286 

283 

Observations  in  Group  5  (n^) 

6530 

6510 

7192 

7146 

Total  dependent  sample  size  (N) 

7956 

7956 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

2652 

2652 

2652 

2652 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

2044 

Number  of  available  predictors  (P) 

467 

467 

467 

467 

Table  7- 2b 

Specification  of  Predictands  -  Atlantic  City  Municipal  Airport 
(As  used  in  prediction  runs  using  Boolean  predictors) 


Predictand 


1 _ 

2 

3 

_ 4_ 

Predictand  variable 

CIG 

CIG 

VIS 

VIS 

Forecast  interval — hours  (H) 

3 

7 

3 

7 

Number  of  Groups  (G) 

5 

5 

5 

5 

Observations  in  Group  1  (n^ ) 

100 

135 

153 

167 

Observations  in  Group  2  (n^) 

281 

272 

125 

130 

Observations  in  Group  3  (n^) 

385 

420 

200 

230 

Observations  in  Group  4  (n^) 

660 

619 

286 

283 

Observations  in  Group  5  (n^) 

6530 

6510 

7192 

7146 

Total  dependent  sample  size  (N) 

7956 

7956 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

2652 

2652 

2652 

2652 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

2044 

Number  of  available  predictors  (P) 

467 

467 

467 

467 

Table  7-3 


Predictors  Available  for  Single-Station  Predictions 
Using  Dummy  Predictors  for  the  Forecast  Station  (ACT) 


Element 

r  mm  ■  i  — >w» 


CIG 


VIS 


No.  of 
Dummies 


5 


10 


5 


10 


Dummy 

No. 

Specifications  and  Limits 

Number  of 
Occurrences 

Ceiling  Height*. 

ft: 

1 . 

0 

< 

CIG 

< 

200 

109 

2. 

200 

< 

CIG 

< 

500 

263 

3. 

500 

< 

CIG 

< 

1000 

410 

4. 

1000 

< 

CIG 

<  3000 

661 

5. 

3000 

< 

CIG 

6513 

(0 

CIG 

100 

53 

(2) 

CIG 

mm 

200 

64 

(3) 

CIG 

SE 

400 

98 

(4) 

CIG 

** 

500 

108 

(5) 

CIG 

- 

900 

62 

(6) 

1500 

< 

CIG 

<  2000 

146 

(7) 

2500 

< 

CIG 

<  3000 

123 

(8) 

3000 

< 

CIG 

<  5000 

596 

(9) 

5000 

< 

CIG 

<  10,000 

722 

do) 

CIG 

=  Unlimited 

4039 

Visibility*,  mi; 

1. 

0 

< 

VIS 

< 

1/2 

139 

2. 

1/2 

< 

VIS 

< 

1 

115 

3. 

1 

< 

VIS 

< 

2 

213 

4. 

2 

< 

VIS 

< 

3 

274 

5. 

3 

< 

VIS 

7215 

(D 

1/4 

< 

VIS 

< 

1/2 

46 

(2) 

1/2 

< 

VIS 

< 

3/4 

52 

(3) 

3/4 

< 

VIS 

< 

1 

63 

(4) 

1 

< 

VIS 

< 

1-1/2 

114 

(5) 

1-1/2 

< 

VIS 

< 

2 

99 

Parentheses  ( )  used  to  help  distinguish  the  two  forms  of  dummies. 


Table  7-3  -  Continued 


No.  of  Dunmy 

Element  Dummies  No.  Specx  float  ions  and  Limits 


WND 


RLH 


TCA 


WEA 


5 


3 


2 


12 


Visibility*,  mi: 

(6)  2  <  VIS  <  3 

(7)  3  <  VIS  <  4 

(8)  4  <  VIS  <  5 

(9)  5  <  VIS  <  6 

(10)  13  <  VIS 

Wind: 

1 .  Calm  to  3  Knots,  any  direction 

2.  23°  to  67°,  3  Knots  <  Speed 

3*  68©  to  202°,  3  Knots  <  Speed 

4.  203°  to  247°,  3  Knots  <  Speed 

5.  248°  to  220,  3  Knots  <  Speed 

Relative  Humidity: 

1 .  75  per  cent  to  85  per  cent 

2#  86  per  cent  to  93  per  cent 

3*  94  per  cent  to  100  per  cent 

Total  Cloud  Amount: 

1.  5/10  to  9/10  (incl.) 

2.  Hare  than  9/10 

Weather  Element**: 

1  •  No  Weather 

2*  Rain 

3*  Rain  Showers 

4*  Drizzle 

5*  Snow 

6»  Snow  Showers 

7»  Thunderstorm,  Hail 


Parentheses  (  )  used  to  help  distinguish  the  two  farms  of  dummies, 

t 

See  Table  1-4  for  a  oomplete  list  of  Weather  Elements. 


Number  of 
Occurrences 

274 

334 

282 

370 

1575 

723 

854 

1727 

1656 

2976 

1387 

1418 

1262 

2026 

2633 

5721 

395 

144 

106 

42 

3 

36 
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Table  7-3  -  Continued 


No.  of  Dvtmny 
Element  Dummies  No. 

8. 

9. 

10. 

11. 

12. 

SCL  3  1 . 

2. 

3. 


Specifications  and  Limit s 

Weather  Elements**: 
Freezing  Rain,  Sleet 
Fog 

Ground  Fog 

Blowing  Snow,  Blowing  Sand 
Smoke,  Haze,  Dust 

Sky  Condition,  Lower? 

Sky  obscured 

Thin  broken  clouds 
Thin  overcast 

Scattered  clouds 
Dark  scattered  clouds 


**See  Table  1-4  for  a  complete  list  of  Weather  Elements. 


Number  of 
Occurrences 


3 

689 

439 

5 

816 

209 

380 

2267 
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T«M  a 

*W,  t/JUV 


n-i. , 


Selected  Predictors  and  KEEP  Equations  Using 
Single- Station  Predictors  in  Raw  Duimqy  Form 

Atlantic  City  3-hr  Ceiling 


Selected  Predictors 
Order  Station  Element  Dummy 


ACT 

CIG 

5 

ACT 

CIG 

1 

ACT 

CIG 

2 

ACY 

CIG 

3 

ACT 

TCA 

2 

ACT 

WEA 

2 

ACY 

VIS 

5 

ACT 

WND 

5 

ACY 

CIG 

(1) 

ACT 

CIG 

(7) 

ACY 

WND 

A 

ACY 

VIS 

(1) 

ACY 

WEA 

9 

ACY 

VIS 

(4) 

ACY 

WEA 

7 

ACY 

CIG 

(8) 

ACY 

VIS 

4 

ACY 

RLH 

2 

ACY 

CIG 

(6) 

ACY 

WND 

1 

ACY 

RLH 

3 

ACY 

RLH 

1 

ACY 

CIG 

(4) 

ACY 

CIG 

(5) 

ACY 

WEA 

4 

ACY 

SCL 

3 

ACY 

VIS 

2 

ACY 

SCL 

1 

ACY 

CIG 

(2) 

ACY 

CIG 

(9) 

Additive  Constant: 


Coefficients  of  the  REEP  Equations 
A1  A2  A3  AA  A5 


-.001 

-.020 

-.1 06 

-.360 

.487 

.365 

.278 

.022 

-.477 

-.188 

.035 

.331 

.017 

-.301 

-.082 

-.006 

.090 

.175 

-.208 

-.052 

.002 

-.005 

.023 

.050 

-.070 

-.025 

.083 

.063 

.018 

-.140 

-.06 1 

.026 

.041 

-.040 

.035 

-.006 

-.026 

-.032 

-.022 

.086 

-.187 

.050 

-.106 

.079 

.1 64 

.004 

.012 

-.086 

-.129 

.200 

-.00? 

-.028 

-.033 

-.013 

.081 

.099 

-.024 

.001 

.040 

-.116 

.004 

.055 

-.001 

.001 

-.059 

-.055 

-.025 

.1 61 

-.049 

-.032 

-.014 

-.035 

-.077 

-.180 

.306 

.001 

-.002 

.014 

.082 

-.095 

-.038 

.018 

.028 

-.026 

.018 

.005 

.013 

.026 

.038 

-.082 

-.008 

-.016 

-.076 

.142 

-.042 

.006 

-.021 

-.042 

-.014 

.071 

.013 

.028 

.038 

.002 

-.082 

-.001 

-.001 

.011 

.039 

-.049 

.004 

-.004 

.109 

-.109 

-.001 

.001 

-.100 

-.018 

.041 

.075 

-.006 

.009 

.082 

.028 

-.112 

.000 

.001 

.008 

.019 

-.028 

.035 

.022 

.097 

—  .066 

-.088 

.002 

-.073 

-.036 

.042 

.065 

.012 

.084 

-.054 

-.042 

-.000 

-.001 

.001 

-.002 

.035 

-.032 

.066 

.014 

.083 

.409 

.428 
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Table  ?-4h 

Selected  Predictors  and  REEP  Equations  Using 
Sir^le-Station  Predictors  in  Raw  Dummy  Fora 

Atlantic  City  7-hr  Ceiling 


Selected  Predictors 
Order  Station  Element  Dummy 


1 

ACi 

CIG 

5 

2 

ACT 

TCA 

2 

3 

ACT 

WND 

5 

4 

ACT 

WND 

4 

5 

ACT 

R1H 

3 

6 

ACT 

CIG 

2 

7 

ACT 

SCL 

1 

8 

ACT 

RLH 

2 

9 

ACT 

WEA 

2 

10 

ACT 

WND 

1 

11 

ACT 

CIG 

4 

12 

ACT 

RLH 

1 

13 

ACT 

WEA 

9 

14 

ACT 

VIS 

(3) 

15 

ACT 

WEA 

4 

16 

ACT 

CIG 

(8) 

17 

ACI 

WEA 

7 

16 

ACT 

CIG 

1 

19 

ACT 

CIG 

(D 

20 

ACT 

VIS 

2 

21 

ACT 

VIS 

4 

22 

ACT 

CIG 

(5) 

23 

ACT 

CIG 

(7) 

24 

ACT 

CIG 

(6) 

25 

ACT 

WEA 

3 

Coefficients  cf  the  REEP  Equations 


At 

A2 

Aj 

*4 

-.010 

-.110 

-.137 

-.079 

.336 

.000 

.011 

.037 

.060 

-.108 

-.025 

-.047 

-.052 

-.039 

.163 

-.022 

-.044 

-.053 

-.035 

.155 

.010 

-.000 

.046 

.086 

-.142 

.006 

.090 

-.016 

-.090 

.011 

.047 

-.074 

-.057 

-.019 

.103 

.009 

.018 

.033 

.050 

-.110 

.001 

.079 

.075 

-.037 

-.117 

-.011 

-.032 

-.047 

-.021 

.111 

-.008 

-.048 

-.088 

.060 

.085 

.007 

.008 

.019 

.032 

-.066 

.025 

.004 

.010 

-.000 

-.039 

.054 

.008 

.090 

-.135 

-.017 

.046 

.044 

.070 

-.016 

-.143 

.004 

.005 

.012 

.039 

-.060 

.010 

.002 

-.130 

-.109 

.228 

.127 

.035 

-.004 

.025 

-.184 

-.122 

-.010 

.042 

-.094 

.184 

.039 

.047 

-.099 

.119 

-.106 

.029 

.014 

.007 

-.045 

-.005 

-.046 

-.079 

-.033 

.116 

.044 

.026 

-.073 

-.005 

-.034 

.086 

.011 

-.063 

-.020 

.070 

.002 

-.001 

-.020 

.063 

.019 

-.061 

Additive  Constants  .029  .146  .174  .115  .536 
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Table  ?-4c 


Selected  Pred,ictors  and  RKEP  Equations  Using 
Single-Station  Predictors  in  Raw  Dummy  Form 


Atlantic  City  3-hr  Visibility 


Selected  Predictors 
Order  Station  Element  Dummy 


1 

ACT 

VIS 

5 

2 

ACT 

VIS 

1 

3 

ACY 

RLH 

3 

4 

ACT 

VIS 

2 

5 

ACY 

WEA 

1 

6 

ACT 

WEA 

9 

7 

ACT 

RLH 

2 

S 

ACT 

CIG 

1 

9 

ACT 

CIG 

(D 

10 

ACY 

WEA 

2 

11 

ACT 

WEA 

5 

12 

ACY 

CIG 

(2) 

13 

ACT 

VIS 

3 

14 

ACY 

SCL 

1 

15 

ACT 

VIS 

(1) 

16 

ACT 

VIS 

(8) 

17 

ACT 

WEA 

4 

18 

ACT 

WEA 

7 

19 

ACT 

WND 

5 

20 

ACT 

WND 

4 

21 

ACT 

VIS 

(4) 

22 

ACT 

WEA 

12 

23 

ACT 

CIG 

3 

Coefficients  cf  the  REEP  Equations 


A1 

A2 

\ 

A? 

-.025 

-.014 

-.067 

-.098 

.204 

.285 

.041 

-.087 

-.150 

-.089 

.034 

.026 

.040 

.035 

-.134 

.156 

.189 

-.016 

-.084 

-.245 

-.036 

.002 

.006 

-.040 

.069 

.000 

.018 

.042 

.047 

-.106 

.011 

.006 

.018 

.027  • 

-.062 

.217 

.017 

.119 

■  .041 

-.395 

-.138 

-.056 

-.086 

-.065 

.344 

-.062 

-.013 

.032 

.026 

.017 

-.060 

.088 

.154 

-.0'  7 

-.135 

-.027 

-.007 

.119 

.036 

-.122 

.053 

.041 

-.053 

-.005 

-.036 

-.071 

.030 

-.031 

-.026 

.098 

-.052 

.022 

.140 

-.062 

-.048 

-.012 

.017 

.005 

.055 

-.064 

-.056 

.025 

.067 

.006 

-.044 

-.081 

-.010 

-.058 

-.036 

.184 

1 

• 

8 

-.010 

-.007 

-.014 

.038 

-.004 

-.010 

-.016 

-.005 

.035 

.030 

-.017 

.082 

-.103 

.008 

-.029 

.006 

.018 

-.014 

.019 

-.029 

-.012 

.011 

.018 

.012 

Additive  Constant:  .064  .021  .069  .149  .697 
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Table  7-4d 


Selected  Predictors  and  REEP  Equations  Using 
Single-Station  Predictors  in  Raw  Dunrtiy  Form 

Atlantic  City  7-hr  Visibility 


Selected  Predictors 
Order  Station  Element  Dungy 


Coefficients  of  the  REEP  Equations 


1 

ACT 

WEA 

9 

.012 

.001 

.044 

.009 

-.066 

2 

ACT 

WEA 

1 

-.011 

-.002 

-.011 

-.028 

.052 

3 

ACT 

WND 

5 

-.013 

-.020 

-.018 

-.027 

.078 

4 

ACT 

WHD 

4 

-.003 

-.017 

-.015 

-.020 

.055 

5 

ACT 

CIG 

2 

.014 

.037 

.053 

.011 

-.115 

6 

ACT 

VIS 

5 

-.048 

-.011 

.002 

.011 

.046 

7 

ACT 

RLH 

2 

.014 

.012 

.022 

.021 

-.069 

8 

ACT 

CIG 

3 

.005 

.004 

.046 

.007 

-.062 

9 

ACT 

VIS 

2 

-.029 

.092 

-.041 

-.010 

-.012 

10 

ACT 

TCA 

2 

-.009 

.001 

.014 

.022 

-.028 

11 

ACT 

CIG 

1 

.121 

-.070 

.072 

.063 

-.186 

12 

ACT 

CIG 

(D 

-.128 

-.023 

-.040 

.065 

.126 

13 

ACT 

VIS 

(3) 

.129 

-.020 

.080 

-.036 

-.153 

14 

ACT 

SCL 

1 

.019 

.068 

fift 

0 

• 

1 

-.032 

-.002 

15 

ACT 

WND 

3 

.021 

.000 

.000 

-.003 

-.018 

16 

ACT 

WEA 

4 

.005 

.051 

-.006 

.008 

-.058 

17 

ACT 

RLH 

3 

.015 

.005 

.010 

.010 

-.040 

18 

ACT 

WEA 

* 

«*• 

-.055 

•046 

.034 

-.010 

-.014 

19 

ACT 

WEA 

2 

-.016 

.000 

.030 

.038 

-.052 

Additive 

Constant: 

.069 

.031 

c026 

.045 

.829 
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Table  7- 5ft 


Selected  Predictors  and  REEP  Equations  Using 
Single-Station  Predictors  in  Boolean  Pairs 

Atlantic  City  3- hr  Ceiling 


Selected  Predictors 

Coefficients 

a 

of  the  REEP  Equations 

a  a  a 

Order 

Station 

Element 

Dummy 

A1 

A2 

_  3 

4 

*5 

1 

ACT 

CIG 

5 

.063 

-.029 

-.064 

-.287 

.318 

2 

ACT 

CIG 

1 

.414 

.215 

.009 

-.378 

-.260 

3 

ACT 

CIG 

2 

.068 

.304 

.039 

-.260 

-.151 

4 

ACT 

CIG 

3 

.005 

.059 

.221 

-.209 

-.076 

5 

,  ACT 

ACT 

TCD  1 93CE-01 3CE 

WEA  9 

.171 

.010 

-.103 

-.082 

.004 

6 

ACT 

TCA 

2 

-.005 

-.021 

-.010 

.063 

-.027 

7 

,  ACT 
and  ACY 

WEA 

WEA 

2-8 

9 

-.039 

.108 

.045 

-.046 

-.068 

8 

OT,  ACT 

ACT 

WND 

TCA 

2 

2 

.014 

.059 

.085 

.038 

-.196 

9 

n  .  ACT 
and  ACY 

WND 

TCA 

3 

2 

.015 

.055 

.069 

-.007 

-.132 

10 

.nrt  ACI 

CIG 

VIS 

5 

5 

-.067 

-.021 

-.048 

-.048 

.184 

11 

ACT 

CIG 

(1) 

-.197 

.040 

-.058 

.075 

.139 

12 

ACT 

WEA 

2 

-.010 

.079 

.039 

.028 

-.136 

13 

ACT 

CIG 

(7) 

.006 

.010 

-.073 

-.171 

.227 

14 

srri  ACT 
and  ACr 

CIG 

TCA 

(6) 

2 

.001 

.004 

.024 

.103 

-.132 

15 

,  ACT 
and  Acr 

TOD  0730E-1330E 

CIG  4 

-.007 

-.061 

-.035 

.150 

-.047 

16 

ACY 
and  ACY 

WEA 

DOT 

2-8 

151-300 

-.004 

-.090 

.076 

-.016 

.035 

Additive  Constant: 

.005 

.054 

.116 

.353 

.472 
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Table  7- 5b 


Selected  Predictors  and  REBP  Equations  Using 
Single-Station  Predictors  in  Boolean  Pairs 

Atlantic  City  7-hr  Ceiling 


Order 

Selected  Predictors 
Station  Element 

Dunay 

Coefficients  of  the  REEP  Equations 

-A1  *2  *1  At  A-5__ 

1 

2 

ACT 

ACT 

CIO 

TCA 

5 

2 

-.005 

.025 

-.049 

.076 

-.069 

.123 

-.129 

.113 

.252 

-.336 

3 

.  ACT 
•nd  ACT 

TOO  1930E-013CE 

WEA  9 

.175 

.024 

-.031 

-.095 

-.074 

4 

,  ACT 
ACT 

WND 

TCA 

a; 

2 

-.037 

-.104 

-.109 

-.063 

.313 

5 

.  ACT 
ACT 

WND 

TCA 

4 

2 

-.034 

-.092 

-.115 

-.050 

.292 

6 

7 

8 

9 

ACT 

ACT 

ACT 

ACT 

RLH 

CIG 

RLH 

WEA 

3 

2 

2 

2 

.023 
—  .006 
.009 
-.005 

.054 

.105 

.023 

.064 

.006 

.007 

.034 

.Qi*4 

.045 

-.089 

.030 

-.018 

-.128 
—.01 6 
-.095 
-.085 

10 

ACI 

ACT 

TOO  133CE-193CE 

VGA  9 

.1p4 

-.002 

-.077 

-.053 

.027 

11 

,  ACT 
ACT 

WND 

TCA 

1 

2 

-.008 

-.063 

-.094 

-.018 

.183 

12 

.  ACI 
ACT 

WND 

TCA 

3 

1 

.020 

.014 

.028 

.050 

-.113 

13 

,  ACT 
*nd  ACT 

DOT 

RLH 

151-300 

3 

-.015 

-.069 

.100 

.021 

-.037 

14 

.  ACT 
ACT 

WEA 

WEA 

2-8 

9 

-.007 

.025 

.132 

-.059 

-.091 

15 

ACT 

SCL 

1 

.072 

-.026 

-.012 

-.026 

-.007 

16 

.  ACT 
ACT 

TOD  O130E-O73CE 

DOT  151-300 

-.015 

-.015 

-.023 

.071 

-.017 

Additive  Constant 

.008 

.051 

.069 

.140 

.732 
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Table  7- 5c 


Selected  Predictors  and  REEP  Equations  Using 
Single -Station  Predictors  in  Boolean  Pairs 

Atlantic  City  3-hr  Visibility 


Selected  Predictors 

Coefficients 

a  a 

of  the  REEP  Equations 

a  a  a 

Order 

Station 

Element  Dummy 

*1 

a2 

...  *3  _ 

*4 

*5 

1 

ACT 

VIS  5 

-.039 

-.029 

-.076 

-.082 

.227 

2 

ACT 

VIS  1 

.290 

.042 

-.008 

-.134 

-.190 

3 

ACT 

RLH  3 

.042 

.036 

.054 

.056 

-.187 

4 

ACT 

VIS  2 

.114 

.179 

-.007 

-.062 

-.224 

5 

,  ACT 
and  ACT 

CIO  5 

WEA  1 

-.002 

-.008 

-.013 

-.042 

.064 

6 

and 

ACT 

TOD  1 930E-01 3CE 

WEA  9 

.133 

.064 

.044 

-.006 

-.236 

7 

,  ACT 
and  . 

ACT 

TOD  1 93CE-01 3QE 

WEA  10 

.121 

-.008 

.012 

-.038 

-.087 

8 

ACT 

RLH  2 

.007 

.005 

.019 

.033 

-.065 

9 

,  .  ACT 

M  ACT 

WND  4 

RLH  3 

-.013 

-.037 

-.081 

-.016 

.147 

10 

and 

ACT 

WEA  2-8 

RLH  2 

-.068 

-.017 

.028 

.008 

.048 

11 

and 

ACT 

WEA  2-8 

TOD  0130E-073GE 

.0 11 

.003 

.053 

.087 

-.153 

Additive  Constant: 

,041 

.038 

.090 

.126 

.706 

Table  7-5d 


Selected  Predictors  and  REEP  Equations  Using 
Single-Station  Predictors  in  Boolean  Pairs 

Atlantic  City  7-hr  Visibility 


Selected  Predictors 

Coefficients 

A  k 

of  ths  REEP  Equations 

A  A  k 

Order 

i  fr  'i  iirWT,,^MiliiiiW 

*1 

2 

a3  4 

....  5 

1 

ACT 

CIG  5 

VIS  5 

-.027 

-.022 

-.057  -.(43 

.140 

2 

ACT 

ACT 

TOO  1 930E-01 3GE 

RLH  3 

.092 

.021 

• 

o 

v» 

VjJ 

1 

-.205 

3 

ACT 

TCa  2 

VflEA  9 

.059 

.044 

.059  .040 

-.201 

4 

ACT 
*nd  ACT 

TCD  193CE-013CE 

RLH  2 

.026 

.020 

.045  .052 

-.143 

5 

ACI 

TCD  1 33GE-1 930E 

VEA  12 

.043. 

.028 

.037  .042 

-.150 

6 

ACT 

WHD  5 

-.018 

-.019 

-.018  -.028 

.083 

7 

ACT 

Wfi)  4 

-.013 

-.017 

-.017  -.020 

.067 

8 

ACT 

VIS  2 

.067 

.095 

-.030  -.04 2 

-.090 

9 

ACT 

TCD  013CB-O73CE 

WEA  9 

-.063 

-.055 

-.028  -.017 

.167 

10 

ACT 

CIG  4 

VIS  5 

-.026 

-.020 

-.039  -.026 

.111 

Additive  Constant: 

.042 

.040 

.077  .077 

.765 

Table  7-6a 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups  When 
Single  Station  Predictors  are  in  Raw  Dunnry  Form  and  When 
Single  Station  Predictors  are  in  Boolean  Form 

Atlantic  City  3-hour  Ceiling  (Independent  Sample) 


Actual 


Group 

1 

2 

3  . 

4 

5 

Total 

1 

9 

4 

2 

0 

3 

18 

KEEP  Single 

2 

20 

36 

27 

10 

10 

103 

Station  Predictors  in 

3 

T 

11 

45 

14 

12 

83 

Raw  Dunmy  Form 

4 

1 

9 

20 

47 

28 

105 

5 

13 

13 

33 

94 

1582 

1735 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  «  1719  P  -  .2246 
P  .0163  .0275  .0440  .0613  .0755 


Actual 


Group 

1 

2 

3 

_4  .... 

5 

Total 

1 

12 

3 

1 

0 

1 

17 

REEF  Single 

2 

19 

38 

27 

10 

10 

104 

Station  Predictors  in 

3 

0 

9 

42 

10 

6 

67 

Boolean  Form  (Pairs) 

4 

1 

7 

16 

40 

29 

93 

5 

12 

16 

41 

105 

1589 

1763 

Total 

44 

73 

127 

165 

16  35 

2044 

Hits  -  1721  P  *  .2275 

P  .0158  .0277  .0442  .0626  *0772 
g 
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lftoxe  y—oo 


Contingency  Tables  Shewing  Predieted-Versus-Actual  Groups  When 
Single  Station  Predictors  are  in  Raw  Dummy  Form  and  When 
Single  Station  Predictors  are  in  Boolean  Fora 

Atlantic  City  7-hour  Ceiling  (Independent  Sample) 


Actual 


Group 

J _ 

2 

3  ... 

4 

_  5 

Total 

KEEP  Single 

Station  Predictors  in 

Saw  Dummy  Fora 

1 

2 

3 

4 

5 

0 

3 

8 

2 

28 

0 

9 

11 

5 

54 

1 

9 

24 

5 

108 

r 

5 

12 

3 

137 

0 

4 

8 

4 

1603 

2 

30 

63 

19 

1930 

Total 

41 

79 

147 

158 

f6l* 

2044 

Hits  *  1 639 


.2678 


P  .0187  .0336  .0564  .0658  .0932 

& 


Actual 

pjyac  J _ 2 _ 2 _ L. _ iL  Mai 


1 

2 

1 

0 

2 

3 

8 

2 

6 

11 

9 

5 

3 

34 

KEEP  Single 

3 

6 

12 

26 

9 

5 

58 

Station  Predictors  in 

4 

4 

7 

13 

8 

6 

38 

Boolean  Fora  (Pairs) 

5 

23 

48 

99 

134 

1602 

1906 

Total 

41 

79 

147 

158 

1619 

2044 

Hits  -  1649 

P  “  • 

2676 

Pg 

.0184 

.0326 

.0567 

.0660 

.0939 
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Table  7-6c 


Contingency  Tables  Showing  Predicted-Versus-Actual  Groups  When 
Single  Station  Predictors  are  in  Raw  Dummy  Form  and  When 
Single  Station  Predictors  are  in  Boolean  Fom 

Atlantic  City  3-hour  Visibility  (Independent  Sample) 


Actual 


Group 

1 

2 

3  . 

4 

5 

Total 

1 

8 

6 

3 

0 

3 

20 

REEP  Single 

2 

0 

2 

6 

0 

5 

13 

Station  Predictors  in 

3 

1 

3 

0 

0 

0 

4 

Raw  Dummy  Form 

4 

0 

0 

0 

0 

0 

0 

5 

33 

35 

69 

93 

1777 

2007 

Total 

P 

g 

42  46 

Hits  =  1 

.0167  .0197 

78 

1787 

.0326 

93 

P  =  . 

.0392 

1785 

1796 

.0713 

2044 

Group 

1 

Actual 

2  3  4 

5 

Total 

1 

16 

9  7  1 

4 

37 

REEP  Single 

2 

0 

1 

0 

0 

3 

4 

Station  Predictors  in 

3 

0 

0 

0 

0 

0 

0 

Boolean  Form  (Pairs) 

4 

0 

0 

0 

0 

0 

0 

c 

y 

26 

36 

71 

92 

1778 

2003 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  *  1795 

P  -  . 

1738 

P 

g 

.0165 

.0201 

.0327 

.0389 

.0705 
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Table  7-6d 


Contingency  Tables  Showing  Predict ed-V e rsu&~ Actual  Groups  fe’hen 
Single  Station  Predictors  are  in  Raw  Dunany  Form  and  When 
Single  Station  Predictors  are  in  Boolean  Form 

Atlantic  City  7-hour  Visibility  (Independent  Sample) 


Actual 


Group 

1 

2 

3 

4 

5 

Total 

1 

0 

0 

0 

0 

0 

0 

REEP  Single 

2 

0 

0 

0 

0 

0 

0 

Station  Predictors  in 

3 

0 

0 

0 

0 

0 

0 

Raw  Dummy  Form 

4 

0 

0 

0 

0 

0 

0 

5 

43 

38 

90 

99 

1774 

2044 

Total 

43 

38 

90 

99 

1774 

2044 

Hits 

-  1774 

P  =  . 

2170 

P 

g 

.0200  . 

0180  .( 

3401 

.0444 

.0945 

Group 

1 

KEEP  Single  2 

Station  Predictors  in  3 

Boolean  Form  (Pairs)  4 

5 

Total 


Actual 


1 

2 

_  3 

4 

5 

Total 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

43 

38 

90 

99 

1774 

2044 

43 

38 

90 

99 

1774 

2044 

Hits  -  1774  P  -  .2140 


Pg  ,0196  .0178  .0398  .0443  .0924 
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Comparison  Between  REEP  Forecasts  Using  Single -Station  Predictors  in 
P.aw  Dumny  Form,  Single-Station  Predictors  in  Boolean  Pairs,  All  the 
Dummy  Predictors  from  the  13-Station  Network*,  and  Persistence*. 


ACY  Ceiling,  3- hr  Forecast  (Independent  Sample) 


Hits 


P  Scare 


Single-Station  Dummies 

1719 

Single -St at ion  Boolean  Pairs 

1721 

Network  Dummies 

1728** 

Per sis tence 

1702 

Single-Station  Dummies 

.2246 

Single-Station  Boolean  Pairs 

.2275 

Network  Dummies 

.2135** 

Persistence 

.2385 

ACY  Ceiling.  7- hr  Forecast  (Independent  Sample) 


Hits 


P  Score 


Single-Station  Dummies  1639 

Single -Station  Boolean  Pairs  1649 

Network  Dummies  1 665** 

Persistence  1588 

Single-Station  Dummies  .2678 

Single-Station  Boolean  Pairs  .2676 

Network  Dummies  .2600** 

Persistence  .2899 


*See  Experiment  No.  1 . 

**Asterisks  are  used  to  denote  superiority. 
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EXPERIMENT  8.  Combination  of  Selected  Predictors  from  Network  am 
Single- Station  Boolean. 

Purpose 

To  determine  the  extent  of  the  improvement  in  the  forecast  when 
using  the  combined  predictors  selected  by  two  separate  methods. 

Procedure 

The  58  predictors  selected  by  KEEP  in  the  four  selection  runs 
(CIG  +  3  hrs,  CIG  +  7  hrs,  VIS  +  3  hrs,  VIS  +  7  hrs)  using  all  the 
dummy  predictors  of  the  13- station  Atlantic  City  network  (see  Experiment 
No.  1)  were  combined  with  the  53  single- station  predictors  selected 
using  the  Boolean-paired  predictors  of  the  forecast  station  (3ee 
Experiment  No.  7).  Eliminating  the  duplication  of  predictors  selected 
in  these  two  ways  resulted  in  78  predictors,  t»hich  were  used  in  this 
experiment  (Table  8-3).  Four  prediction  runs  were  made  and  the  results 
compared  with  the  results  using  the  network  predi-  tors  (Experiment  No.  1) 
and  the  Boole  an- paired  predictors  (Experiment  No.  ?}« 

Predictands 

As  before ,  the  predictands  are  divided  into  five  operationally 
significant  intervals  of  ceiling  and  visibility  (Table  8-1)*  The 
specifications  of  the  predictands  are  listed  in  Table  8-2. 

Predictors 

The  78  predictors  used  in  this  experiment  are  shown  in  Table  8-3, 
with  the  number  of  occurrences  of  each  in  the  developmental  sample  of 
7956  observations  also  shown.  The  specifications  and  limits  of  the 
dummy  variables  are  as  previously  indicated  in  Table  1-4. 
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Data  Sample 


The  data  sample  consists  of  10,000  observations  selected  at  random 
from  the  ten-year  period,  1  January  1949  to  31  December  1958.  The  de¬ 
velopmental  sample  consists  of  7956  observations  from  the  first  eight 
years  of  the  data  sample  and  the  verification  sample  consists  of  2044 
observations  from  the  last  two  years  of  the  ten-year  period. 

Results 

The  predictors  selected  by  KEEP  for  the  four  selection  runs  are 
shown  in  Tables  8-4a  to  8-4d.  The  KEEP  regression  equation  coefficients 
for  each  group  of  the  predictand  is  also  shown.  Contingency  tables 
(Tables  8-5&  to  8-5d)  show  the  fere  cast- versus- observed  frequencies 
fer  the  3-hour  and  7-hour  predictions  of  ceiling  and  visibility  using 
the  co shined  predictors  as  previously  described.  The  number  of  correct 
forecasts  (hits),  the  Brier  and  Allen  P  scores,  and  the  individual  group 
contributions  to  the  overall  P  score  are  given.  The  comparison  of  the 
hits  and  the  P  scores  achieved  by  these  combined  predictors  with  the 
hits  and  P  sco'£*  of  the  network  predictors  alone,  and  the  Boole en- 
paj^red  single  station  predictors  alone,  is  shown  in  Table  8-6. 
Conclusions 

The  results  of  this  combined  study  are  a  decided  improvement  over 
either  the  network  car  the  single  station  Boolean  predictors  taken 
separately.  This  suggests  that  Boolean  predictors  generated  between 
network:  variables  might  even  improve  upon  the  results  obtained*  in 
the  present  combination. 
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Table  8-1 


Definition  of  Predictand  Groups  for  Atlantic  City  Municipal  Airport 


Group 

Number 

Ceiling  Intervals 

1 

0  f  t  < 

Ceiling  <  200  ft 

2 

200  ft  < 

Ceiling  <  500  ft 

3 

500  ft  < 

Ceiling  <  1000  ft 

4 

1000  ft  < 

Ceiling  <  3000  ft 

5 

3000  ft  < 

Ceilir^ 

Group 

Number 

Visibility  Intervals 

1 

0  mi  < 

Visibility  <  1/2  mi 

2 

1/2  mi  < 

Visibility  <  1  mi 

3 

1  mi  < 

Visibility  <  2  mi 

4 

2  mi  < 

Visibility  <  3  nd 

5 

3  »i  < 

Visibility 
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Table  8-2 


Specification  of  Predictands  -  Atlantic  City  Municipal  Airport 


Predict and 


1 

2 

_ 2_ 

_ 4_ 

Predictand  variable 

CIG 

CIG 

VIS 

VIS 

Forecast  interval — hours  (H) 

3 

7 

3 

7 

Number  of  Groups  (G) 

5 

5 

5 

5 

Observations  in  Group  1  (n^) 

100 

135 

153 

167 

Observations  in  Group  2  (n^,) 

281 

272 

125 

130 

Observations  in  Group  3  (n^) 

385 

420 

200 

230 

Observations  in  Group  4  (n^) 

660 

619 

286 

283 

Observations  in  Group  5  (n^) 

6530 

6510 

7192 

7146 

Total  dependent  sample  size  (N) 

7956 

7956 

7956 

7956 

Number  of  independent  observations 
in  the  dependent  sample  (n) 

2652 

2652 

2652 

2652 

Total  independent  sample  size  (M) 

2044 

2044 

2044 

2044 

Number  of  available  predictors  (P) 

78 

78 

78 

78 

Predictor 

Humber 

Station 

Element 

Dittany 

Number  of 
Occurrence 

1 

ACT 

TOD 

1 

3994 

2 

NEL 

CIG 

3 

411 

3 

NEL 

TCA 

2 

2671 

4 

NEL 

WEA 

1 

5042 

5 

NEL 

WEA 

2 

423 

6 

NEL 

WEA 

9 

345 

7 

PHL 

CIG 

1 

42 

8 

PHL 

CIG 

5 

6726 

9 

PKL 

WND 

3 

1192 

10 

PHL 

WEA 

1 

4760 

11 

PHL 

WEA 

7 

25 

12 

SET 

CIG 

4 

654 

13 

SET 

CIG 

5 

6678 

14 

SET 

VIS 

2 

91 

15 

SET 

VIS 

5 

7436 

16 

SET 

WEA 

2 

319 

17 

SET 

WEA 

9 

751 

18 

MDT 

VIS 

2 

107 

19 

ACI 

CIG 

1 

109 

20 

ACT 

CIG 

2 

263 

21 

ACT 

CIG 

3 

410 

22 

ACT 

CIG 

4 

661 

23 

ACT 

CIG 

5 

6513 

24 

ACT 

CIG 

(D 

53 

25 

ACT 

CIG 

(6) 

146 

26 

ACT 

VIS 

1 

139 

27 

ACT 

VIS 

2 

115 

28 

ACT 

VIS 

3 

213 

29 

ACT 

VIS 

4 

274 

30 

ACT 

VIS 

5 

7215 

31 

ACT 

RLH 

3 

1262 

32 

ACT 

SCL 

1 

209 

33 

ACT 

TCA 

2 

2633 

34 

ACT 

WEA 

1 

5721 

35 

ACT 

WEA 

9 

689 

36 

DCA 

CIG 

3 

283 

37 

DCA 

CIG 

5 

6943 

33 

DCA 

VIS 

5 

7568 

39 

DCA 

RLH 

3 

526 

40 

DCA 

WEA 

2 

423 
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Table  8-3  -  Continued 


'redictar 

Number 

Station 

Element 

Duinay 

Number  of 
Occurrences 

41 

DCA 

WEA 

9 

512 

42 

ORF 

RLH 

3 

791 

43 

PSB 

CIG 

1 

206 

44 

PSB 

R1H 

3 

1595 

45 

PSB 

wEA 

6 

43 

46 

SWF 

WND 

3 

1007 

47 

IDL 

VIS 

3 

174 

48 

IDL 

WND 

2 

1025 

49 

ACT 

CIG 

(7) 

123 

50 

ACT 

WND 

4 

1676 

51 

ACT 

WND 

5 

2976 

52 

ACT 

RLH 

2 

1418 

53 

ACT 

WEA 

2 

395 

54 

ACI 

41111  ACT 

TO) 

DOT 

1 

1 

841 

55 

flT,  ACT 

411(1  ACT 

TOD 

WEA 

2 

9 

258 

56 

,  ACT 
and  ACY 

TOD 

CIG 

3 

4 

243 

57 

,  ACY 

411(1  ACT 

TOD 

WEA 

4 

9 

118 

58 

,  ACT 

ani  act 

TO) 

WEA 

4 

12 

290 

59 

,  act 

and  ACY 

TOD 

RLH 

5 

2 

505 

60 

,  ACT 
and  ACY 

TOD 

RLH 

5 

3 

425 

61 

onH  ACT 

4Kl  ACT 

TOD 

WEA 

5 

9 

160 

62 

.  ACT 

41x1  ACT 

TOO 

WEA 

5 

10 

105 

63 

.  ACT 
and  ACY 

DOT 

RLH 

1 

3 

578 

64 

,  ACT 
'  40(1  ACT 

CIG 

TCA 

3 

2 

383 

65 

,  ACT 

4nd  ACT 

CIG 

VIS 

5 

5 

6264 

66 

.  ACY 
and  Acy 

CIG 

WEA 

5 

1 

5277 
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Table  8-3 

Predictor 

Number 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 


Cont inued 


Number  of 


Station 

Element 

Dummy 

Occurrences 

1 

i 

,  ACT 

411(1  ACT 

CIG 

TCA 

(8) 

2 

332 

1 

i 

,  ACT 

411(1  ACT 

YUS) 

TCA 

1 

2 

233 

,  ACT 
and  ACT 

WND 

TCA 

2 

2 

496 

,  ACT 
&nd  ACy 

WND 

TCA 

3 

1 

538 

,  ACT 

41x1  ACT 

WND 

TCA 

3 

2 

754 

i 

.  ACT 

41x1  ACT 

WND 

RLH 

4 

3 

236 

■ 

i 

: 

.  ACT 
and  ACY 

WND 

TCA 

4 

2 

492 

ar,  ACT 

41x1  ACT 

WND 

TCA 

5 

2 

658 

| 

,  ACT 

41x1  ACT 

WEA 

TCD 

(1-8) 

2 

182 

! 

ACT 

40(1  ACT 

WEA 

DOT 

(1-8) 

1 

215 

' 

,  ACT 
***  ACT 

WEA 

R1H 

(1-8) 

3 

424 

.  ACT 

and  act 

WEA 

WEA 

(1-8) 

9 

273 

I 
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Table  8-4a 

Selected  Predictors  and  BEEP  Equations 
(Ccobined  Network  and  Single  Station  Boolean  Predictors} 
Atlantic  City  3-hr  Ceiling 


Order 

Selected  Predictors 
Station  Element 

Dummy 

1 

ACI 

CIG 

5 

2 

ACT 

CIG 

1 

3 

PHL 

CIG 

5 

4 

ACT 

CIG 

2 

5 

,  ACT 
ACT 

TOD 

WEA 

5 

9 

6 

,  ACT 
ACT 

CIG 

TCA 

3 

2 

7 

DCA 

CIG 

5 

8 

SBT 

CIG 

5 

9 

NEL 

TCA 

2 

10 

anri  ACT 
and  ACI 

CIG 

VIS 

5 

5 

11 

DCA 

RLH 

3 

12 

NEL 

CIG 

3 

13 

ACT 

WEA 

WEA 

0-8) 

9 

14 

1DL 

WND 

2 

15 

SBT 

CIG 

4 

16 

SWF 

WND 

3 

17 

ACT 

CIG 

(6) 

18 

SBT 

WEA 

2 

19 

NEL 

WEA 

2 

20 

ACT 

CIG 

2 

21 

.tvi  ACT 

CIG 

TCA 

(8) 

2 

22 

ACT 

VIS 

1 

23 

andf® 

ACT 

TOO 

CIG 

3 

4 

Additive  Constant; 


Coefficients 

of  the 

KEEP  Equations 

Ai 

■^2 

A3 

\ 

A5 

.044 

-.014 

-.008 

-.168 

•  I46 

c264 

.215 

.003 

-.295 

-.188 

.008 

-.021 

-.066 

-.129 

.208 

.062 

.262 

.009 

-.216 

-.118 

.164 

.015 

-.082 

-.057 

-.040 

.006 

.038 

.188 

-.157 

-.075 

.004 

-.021 

-.050 

-.050 

.117 

1 

. 

0 

-.057 

-.034 

-.006 

.110 

.003 

.007 

.010 

.042 

-.062 

t/\ 

0 

• 

• 

-.008 

-.035 

-.020 

.115 

.011 

.067 

.000 

-.048 

-.030 

-.008 

-.010 

.085 

-.023 

-.044 

-.038 

.099 

-.003 

-.051 

-.007 

.009 

.018 

.016 

.030 

-.074 

-.016 

-.073 

-.026 

.098 

.017 

.007 

.023 

.021 

.019 

-.071 

-.007 

-.016 

-.041 

.171 

-.108 

-.006 

.070 

-.009 

.054 

-.109 

-.018 

.003 

.072 

-.037 

-.020 

-0OO4 

-.073 

.075 

-.009 

.012 

.002 

-.015 

.002 

.087 

-.077 

.069 

-.052 

-.063 

.035 

.011 

-.003 

-.046 

-.031 

.115 

-.036 

.009 

.116 

.190 

.381 

.305 
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Table  6-4b 

Selected  Predictors  aid  REEP  Equations 
(Combined  network  and  Single  Station  Boolean  Predictors) 
Atlantic  City  7- hr  Ceiling 


Selected  Predictors 
Station  Elaeent 

Coefficients  of  the  REEP  Equations 
AJ  h.  A3  A4  A5 

1 

FHL 

CI6 

5 

0OO3 

-.038 

-.045 

-.084 

.164 

2 

OCA 

GIG 

5 

-.001 

-.001 

-.040 

-.074 

.116 

3 

ACT 

TOD 

USA 

5 

9 

.174 

.033 

-.006 

-.100. 

-.101 

4 

ACT 

TGA 

2 

-.007 

-.020 

.000 

.052 

-.026 

5 

IDL 

HMD 

2 

-.002 

;022 

.040 

.035 

-.096 

6 

FHL 

WD 

3 

.023 

.012 

.025 

.044 

~.1<* 

7 

ACT 

CIO 

5 

-.006 

-.022 

-.029 

-.070 

.127 

8 

DCA 

ISA 

2 

-.016 

.052 

.117 

—.026 

-.127 

9 

MEL 

USA 

9 

.014 

.019 

.056 

.011 

-.100 

10 

aHi  ACT 
">1  ACT 

MD 

TCA 

2 

2 

•020 

.067 

.093 

.012 

-.192 

11 

—  iS 

ACT 

HKD 

TCA 

3 

2 

.025 

.063 

.055 

-.000 

-.142 

12 

—  iS 

ACT 

TCD 

WA 

4 

9 

•104 

.017 

-.029 

-.076 

-.017 

13 

ACT 

TOD 

DOT 

1 

1 

-.017 

-.022 

-.032 

.066 

•006 

14 

DOT 

RLH 

1 

3 

-.005 

-.038 

.062 

.029 

-.068 

15 

DCA 

CIO 

3 

.000 

.088 

-.003 

-.053 

-.032 

16 

ACT 

CIG 

2 

-.008 

.087 

-.002 

-.127 

.051 

17 

ACT 

SCL 

1 

.073 

-.041 

-.037 

-.022 

.027 

18 

SBT 

USA 

9 

•Oil 

.046 

.002 

.030 

-.088 

19 

PSB 

Rlli 

3 

,011 

.004 

.019 

.022 

-.056 

20 

ACT 
*nd  ACT 

USA 

TOD 

0-8) 

2 

-.014 

.010 

.106 

-.035 

-.067 

21 

PSB 

CIG 

1 

.002 

•076 

-.037 

-.025 

—.016 

Additions 

Constant: 

.007 

.064 

.111 

.237 

*581 
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Table  8-4C 


Selected  Predictors  and  KEEP  Equations 
(Combined  Network  and  Single  Station  Boolean  Predictors) 
Atlantic  City  3-hr  Visibility 


Selected  Predictors 

Coefficients  of  the  REEP  Equations 

A  A  A  A  A 

Order 

Station 

Element  Dummy 

A1 

2 

3 

“4 

*5 

1 

ACY 

VIS  5 

-.034 

-.017 

-.056 

-.053 

.161 

2 

ACT 

VIS  1 

.229 

.037 

-.023 

-.158 

-.085 

3 

ACT 

RLH  3 

.027 

.027 

.036 

.023 

-.114 

4 

ACY 

VIS  2 

.089 

.173 

-.019 

-.077 

-.166 

5 

DCA 

WEA  9 

.009 

.010 

.029 

.047 

-.095 

6 

SBY 

VIS  5 

-.001 

-.020 

-.026 

-.060 

.107 

7 

,  ACY 
and  ACY 

TOD  5 

WEA  9 

.122 

.066 

.043 

-.019 

-.212 

8 

ACT 
and  ACy 

TOD  5 

WEA  10 

.131 

-.001 

.028 

-.030 

-.127 

9 

NEL 

WEA  9 

.008 

.011 

.020 

.052 

-.091 

10 

.  ACY 
and  ACY 

WEA  (1-8) 

RLH  3 

-.068 

-.023 

.015 

-.009 

.085 

11 

ACY 

WEA  1 

-.001 

-.003 

-.008 

-.045 

.056 

12 

MDT 

VIS  2 

-.019 

.021 

.119 

-.027 

-.095 

13 

ORF 

RLH  3 

.035 

,009 

.004 

.005 

-.053 

14 

,  ACY 
and  ACy 

WND  4 

RLH  3 

-.005 

-.031 

-.072 

.003 

.104 

15 

ACY 

CIG  1 

.102 

-.008 

.001 

-.017 

-.078 

16 

.  ACY 
&nd  ACY 

WEA  (1-8) 

TOD  2 

.006 

.006 

.053 

.078 

-.143 

17 

,  ACY 
axid  Acy 

TOD  4 

WEA  9 

.028 

.048 

.042 

,023 

-.141 

Additive  Constant: 

.034 

.042 

.093 

.164 

.667 

Table  8-4d 

Selected  Predictors  and  REEP  Equations 
(Combined  Network  and  Single  Station  Boolean  Predictors) 
Atlantic  City  7- hr  Visibility 


Selected  Predictors 

Order 

Station 

Element 

Dummy 

1 

,  ACY 
and  ACT 

CIG 

VIS 

5 

5 

2 

,  ACY 
and  ACy 

TOD 

RLH 

5 

3 

3 

DCA 

VIS 

5 

4 

ACY 

TCO 

1 

5 

PHL 

WEA 

1 

6 

ACY 

WEA 

9 

7 

DCA 

WEA 

2 

8 

IDL 

VIS 

3 

9 

PHL 

Wl© 

3 

10 

ACY 

VIS 

2 

11 

flnH  ACY 
and  ACy 

TCD 

WEA 

2 

9 

12 

.  ACY 
and  ACY 

TCD 

RLH 

5 

2 

13 

,  ACY 
and  ACY 

TOD 

WEA 

4 

12 

14 

ACY 

CIG 

2 

15 

.  ACY 
and  ACY 

WND 

TCA 

2 

2 

Coefficients  of  the  REEP  Equations 

A1 

A2 

_  A3 

\ 

A5 

-.010 

-.005 

-.019 

-.012 

.046 

.083 

.017 

.046 

.035 

-.180 

-.040 

-.033 

-.035 

-.071 

.179 

-.019 

-.009 

-.011 

-.013 

.052 

-.009 

-.004 

-.018 

-.022 

.054 

.063 

.030 

.058 

.022 

-.173 

-.026 

-.018 

.062 

.078 

-.096 

.085 

-.003 

-.037 

.017 

-.062 

.013 

.020 

.020 

.013 

-.067 

.061 

.087 

-.023 

-.036 

-.089 

£ 

0 

• 

1 

1 

. 

0 

vn 

-.033 

-.011 

.168 

.017 

.016 

.036 

.042 

-.111 

.028 

.024 

.032 

.034 

-.118 

-.001 

.061 

.019 

-.020 

-.059 

-.003 

.019 

.035 

.034 

-.086 

Additive  Constant:  .069  .049  .076  .117  .689 


Table  8- 5a 


Contingency  Tables  Showing  Predicted-Versua-Actual  Groups  for 
(1)  Combined  Predictors  Selected  from  Network  and  Single-Station 
Boolean,  (2)  Network  Alone,  and  (3)  Single-Station  Boolean  Alone 

Atlantic  City  3-hr  Ceiling  (Verification  Sample) 

Actual 


Groun 

1 

2 

-  3 . 

4 

5 

Toial 

1 

14 

1 

2 

0 

3 

20 

2 

14 

35 

25 

7 

2 

$3 

BEEP  Using 

3 

0 

10 

40 

14 

6 

70 

Combined  Predictors 

4 

0 

6 

19 

44 

21 

90 

5 

16 

21 

41 

100 

1603 

1781 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  - 

1736 

P  « 

2114 

/ 

Pg 

.0155 

.0276 

.0422 

.0600 

.0660 

Actual 

Group 

J _ 

2 

...  3 

4 

5 

Total 

1 

6 

4 

1 

0 

1 

12 

REEP  Using 

2 

19 

34 

25 

3 

4 

90 

Network  Predictors 

3 

0 

11 

42 

14 

5 

72 

4 

1 

6 

19 

41 

20 

87 

(See  Experiment  No.  1 ) 

5 

16 

18 

40 

102 

1605 

1783 

Total 

44 

7> 

127 

165 

1635 

2044 

Hit 8  « 

1726 

P  -  .2135 

P 

g 

.0163 

.0277 

.0423 

.0605 

.0666 

Actual 


Group 

J _ 

2 

.  3 

.  4 

5 

Total 

BEEP  Using 

1 

12 

3 

1 

0 

1 

17 

Single-Station 

2 

19 

38 

27 

10 

10 

104 

Boolean  Predictors 

3 

0 

9 

42 

10 

6 

67 

(See  Experiment  No.  7) 

4 

1 

7 

16 

40 

29 

93 

5 

12 

16 

41 

105 

1589 

1763 

Total 

44 

73 

127 

165 

1635 

2044 

Hits  “ 

1721 

F  «  .2275 

P 

g 

.01 58 

.0277 

.0442 

.0626 

.0772 
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Table  8-5b 


Contingency  Tables  Showing  Prsdicted-Versus-Actual  Groups  for 
(1)  Combined  Predictors  Selected  from  Network  and  Single-Station 
Boolean,  (2)  Network  Alone,  and  (3)  Single-Station  Boolean  Alone 


Atlantic 

City  7-hr  Ceiling  (Verification 

Actual 

Group  123 

Sample) 

_ 4  5 

Total 

1 

0 

2 

1 

2  1 

6 

2 

7 

12 

6 

0  2 

27 

RKEP  Using 

3 

2 

18 

39 

14  9 

82 

Combined  Predictors 

4 

5 

4 

14 

13  4 

40 

5 

27 

43 

87 

129  1603 

1889 

Total 

41 

79 

147 

158  1619 

20*4 

Hits  «  1667 

P  -  .2576 

■ 

P 

g 

.0  m 

►  .0320 

.0531 

.0661  .0879 

Actual 

Group 

1 

_ 

_ 2 _ 

_ 4-  5 

Mai 

1 

0 

0 

0 

0  0 

0 

BEEP  Using 

2 

3 

9 

9 

1  2 

24 

Network  Predictors 

3 

7 

19 

34 

12  9 

81 

4 

8 

7 

22 

20  6 

63 

(See  Experiment  No.  1) 

5 

23 

44 

82 

125  1602 

1876 

Total 

41 

79 

147 

158  1619 

2044 

Hits  -  1665 

P  -  .2600 

P 

g 

.0180 

.0323 

.0540 

.0666  .0891 

Actual 

Group 

1 

2 

3 

4  5 

Total 

BEEP  Using 

1 

2 

1 

0 

2  3 

8 

Single-Station 

2 

6 

11 

9 

5  3 

34 

Boolean  Predictors 

3 

6 

12 

26 

9  5 

58 

4 

4 

7 

13 

8  6 

38 

(See  Experiment  No.  7) 

5 

23 

48 

99 

134  1602 

1906 

Total 

41 

79 

147 

158  1619 

2044 

Hits  »  1649 

P  «  .2676 

P 

g 

.0184 

.0326 

.056*/ 

.0660  .0939 
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HEEP  Using 
Combined  Predictors 


Actual 


Total 


1 

16 

9 

3 

0 

2 

30 

2 

2 

2 

3 

C 

5 

12 

3 

0 

3 

0 

1 

1 

5 

4 

0 

1 

4 

3 

0 

8 

5 

24 

31 

68 

89 

1777 

1989 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  *= 

1798 

P  =  . 

1772 

P 

g 

.0162 

.0200 

.0330 

.0389 

.0690 

Actual 


Total 


1 

13 

9 

5 

1 

4 

32 

HEEP  Using 

2 

2 

5 

4 

0 

9 

20 

Network  Predictors 

3 

0 

2 

0 

0 

0 

2 

4 

0 

0 

3 

4 

0 

7 

(See  Experiment  No.  1) 

5 

27 

30 

66 

88 

1772 

1983 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  « 

1794 

P  =  . 

1800 

P 

g 

.01 69 

.0199 

.0331 

.0395 

.0707 

Group 


Actual 


Total 


KEEP  Using 

1 

16 

9 

7 

1 

4 

37 

Sir^le-Station 

2 

0 

1 

0 

0 

3 

4 

Boolean  Predictors 

3 

0 

0 

0 

0 

0 

0 

(See  Experiment  No.  7) 

4 

0 

0 

0 

0 

0 

0 

5 

26 

36 

71 

92 

1778 

2003 

Total 

42 

46 

78 

93 

1785 

2044 

Hits  *= 

1795 

P  -  . 

1788 

P 

g 

.0165 

.0201 

.0327 

.0389 

.0705 

U  2 


Table  8-5d 


Contingency  Tables  Showing  Predicted- Versus -Actual  Groups  for 
(1)  Combined  Predictors  Selected  from  Network  and  Single-Station 
Boolean,  (2)  Network  Alone,  and  (3)  Single-Station  Boolean  Alone 

Atlantic  City  7-hr  Visibility  (Verification  Sample) 

Actual 


Group 

J _ _ 

2 

3 

4 

Total 

1 

1 

0 

1 

1 

1 

4 

2 

0 

0 

0 

0 

0 

0 

REEP  Using 

3 

0 

0 

0 

0 

0 

0 

Combined  Predictors 

4 

0 

0 

0 

0 

0 

0 

5 

42 

38 

89 

98 

1773 

2040 

Total 

43 

38 

90 

99 

1774 

2044 

Hits  ** 

1774 

p  *  .: 

2141 

P 

g 

.0193 

.0179 

.0797 

.0447 

.0924 

Actual 

Group 

J _ 

2 

3 

4 

_  5. 

Total 

1 

0 

0 

1 

0 

1 

2 

REEP  Using 

2 

0 

0 

0 

0 

0 

0 

Network  Predictors 

3 

0 

0 

0 

0 

0 

0 

4 

0 

0 

A 

u 

0 

0 

0 

(See  Experiment  No.  1 ) 

5 

43 

38 

89 

99 

1773 

2042 

Total 

43 

38 

90 

99 

1774 

2044 

Hits  * 

1773 

P  .; 

2150 

P 

g 

.0196 

.0178 

.0394 

.0446 

.0936 

Actual 

Group 

J _ 

2 

3 

4 

5 

Total 

REEP  Using 

1 

0 

0 

0 

0 

0 

0 

Sipg le-Station 

2 

0 

0 

0 

0 

0 

0 

Boolean  Predictors 

3 

0 

0 

0 

0 

0 

0 

4 

0 

0 

0 

0 

0 

0 

(See  Experiment  No.  7) 

5 

43 

38 

90 

99 

1774 

2044 

Total 

43 

38 

90 

99 

1774 

2044 

Hits  ■* 

1774 

P  * 

2140 

P 

g 

.0196 

.0178 

.0398 

.0443 

.0924 
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Table  8-6 


Comparison  Between  (1)  Combined  Predictors  Selected  from  Network 
and  Single-Station  Boolean,  (2)  Network  Predictors  Alone*,  and 
(3)  Single-Station  Boolean  Predictors  Alone**. 

(Verification  Sample) 

ACY  Ceiling.  3-hour  Forecast 

Combined  Predictors  1736# 

Hits  Network  Predictors  1728 

Single-Station  Predictors  17 21 

—  Combined  Predictors  .2114# 

P  Score  Network  Predictors  .2135 

Single-Station  Predictors  .2275 

ACY  Ceiling.  7-hour  Forecast 

Combined  Predictors  1667# 

Hit 8  Network  Predictors  1665 

Single-Station  Predictors  1649 

__  Combined  Predictors  .2576# 

P  Score  Network  Predictors  .2600 

Single-Station  Predictors  .2676 

ACY  Visibility,  3- hour  Forecast 

Combined  Predictors  1798# 

Hits  Network  Predictors  1794 

Single-Station  Predictors  1795 

_  Combined  Predictors  .1772# 

P  Score  Network  Predictors  .1800 

Single- Station  Predictors  .1788 

ACY  Visibility.  7-hour  Forecast 

Combined  Predictors  1774# 

Hits  Network  Predictors  1773 

Single-Station  Predictors  1774# 

_  Combined  Predictors  .2141 

P  Score  Network  Predictors  .2150 

Single-Station  Predictors  .2140# 

*See  Experiment  No.  1 . 

*#See  Experiment  No.  7. 

^Denotes  superiority. 
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5*0  DISCUSSION 

The  REEP  procedure  has  the  following  features  to  recommend  its  use 
over  MDA: 

Feature  1 :  The  series  of  G  regressions  in  KEEP  need  not  be  restricted 
to  mutually  exclusive  or  exhaustive  events  as  in  MDA.  Thus, 
any  corah  ira tion  of  conditions  may  be  done  simultaneously* 

For  example,  the  following  series  of  predictand  elements 
might  be  considered  in  a  single  KEEP  analysis,  where  G  =*  15« 


Yj  =  equal  to  unity  if 

0  f t  <  ceiling  < 

200  ft 

*=  equal  to  unity  if 

200  ft  <  ceiling  < 

500  ft 

Y^  =  equal  to  unity  if 

500  ft  <  ceiling  < 

1000  ft 

Y^  =  equal  to  unity  if 

1000  ft  <  ceiling  < 

1500  ft 

Y^  ®  equal  to  unity  if 

1 50 0  ft  <  ceiling 

Yg  =  equal  to  unity  if 

0  mi  <  visibility  < 

1/2  mi 

Yy  =  equal  to  unity  if 

1  /2  mi  <  visibility  < 

1  mi 

Yg  ~  equal  to  unity  if 

1  mi  <  visibility  < 

2  mi 

Y^  *s  equal  to  unity  if 

2  mi  <  visibility  < 

3  mi 

Y10-  equal  to  unity  if 

3  mi  <  visibility 

0  ft  <  ceiling  < 

200  ft 

Y..  **  equal  to  unity  if 

or 

0  mi  <  visibility  < 

1/2  mi 

200  ft  <  ceiling  < 

500  ft 

Y15  *=  equal  to  unity  if 

or 

1/2  mi  <  visibility  < 

1  mi 

500  ft  <  ceiling  < 

1000  ft 

Y.,  =  equal  to  unity  if 

or 

1  mi  <  visibility  < 

2  mi 

U5 


1000  f t  <  ceiling  <  1500  ft 
Yly  =*  equal  to  unity  if  or 

4  2  mi  <  visibility  <  3  mi 

1 500  ft  <  ceiling 

Y.  j.  «  equal  to  unity  if  or 

1  J  3  mi  <  visibility 

This  feature  has  been  made  use  of  in  Experiment  5« 

Feature  2s  Predictor  selection  in  REEP  is  not  biased  by  the  group 
frequencies  as  is  the  case  in  MDA  predictor  selection. 

This  is  because  each  predictand  variable  (e.g», 

Yj ,Y2»...,Yq)  is  considered  separately  and  distinctly 
during  selection.  Most  importantly,  at  the  time  of 
termination  of  selection,  the  significance  test  says 
thsre  is  no  predictor  able  to  provide  a  significant 
contribution  to  any  one  of  the  G  predictand  variables . 
For  example,  if  the  series  of  predictand  variables  is  the 
usual  five  ceiling  categories  then  predictors  able  to 
discriminate  category  1  (ceiling  <  100  ft)  are  being 
considered  on  an  equal  basis  with  those  able  to  discri¬ 
minate  category  5  (ceiling  >  1500  ft).  Another  important 
feature  in  REEP  selection  is  that  the  effective  degrees 
of  freedom,  after  account  is  taken  of  serial  correlation, 
may  be  determined  for  each  predictand  variable  separately 
and  distinctly.  For  example ,  high  ceiling  conditions  have 
a  very  high  serial  correlation  (lew  effective  degrees  of 
freedom  for  nearly  consecutive  observations)  whereas  low 
ceiling  conditions  have  a  low  serial  correlation  (high 
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effective  degrees  of  freedom  for  consecutive  observations)* 

The  facility  to  avoid  the  use  of  an  average,  as  is  unfortu¬ 
nately  required  in  MDA,  aids  somewhat  in  selecting  predictors 
having  discriminatory  information  regarding  the  low  conditions. 

Feature  3:  The  mode  of  calculation  in  the  PEEP  procedure  has  an  additive 
structure  in  place  of  the  multiplicative  structure  in  MDA. 

That  is,  for  both  development  and  operational  use  REEP  needs 
only  the  logical  and  arithmetic  operations  of  addition  which 
are  faster  relative  to  the  arithmetic  operations  of  multi¬ 
plication  required  in  the  distance  neighborhood  portion  of 
MDA.  This  has  a  decided  effect  on  the  speed  with  which  b(fch 
the  statistical  development  and  operational  forecasting  may 
be  performed  using  the  two  techniques.  The  factor  is  in 
favor  of  REEP  over  MDA  by  about  four  to  one  (confirmed)  in 
development  and  by  300  to  one  (estimated)  in  making  operational 
forecasts. 

Feature  4:  It  appears  that  REEP  permits  physical  end  synoptic  inter- 

pretation  of  the  selected  predictors  and  the  effect  each  has 
on  the  probability  of  the  event  being  forecast.  For  example, 
in  Experiment  1  (Table  1~5c)  it  can  be  seen  that  if  the  9th 
predictor  is  a  one  (condition  FHL  ceilir^  <  200  ft  is  being 
observed)  then  .183  is  added  to  the  probability  that  the 
visibility  condition  three  hours  hence  will  be  <  l/2  mile, 
whereas  the  other  visibility  categories  add  or  subtract  the 
following  probability  amounts:  .018,  -.079,  -.084,  and 
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-.039.  However,  the  danger  still  exists  for  misinterpretation 
as  a  result  of  intercorrelation  among  predictors. 

Feature  $:  In  operational  forecasting,  the  KEEP  procedure  can  deal  more 
efficiently  than  MDA  with  the  problem  of  missing  data  or  with 
previously  unobserved  weather  combinations.  The  reason  for 
this  is  that  the  output  from  REEP  is  a  set  of  IBM  cards  con¬ 
taining  a  series  of  regression  equations  and  a  matrix  and 
vector  of  crossproducts.  If  the  value  of  a  predictor  vari¬ 
able  is  unavailable  for  making  ah  operational  forecast,  a 
new  equation  omitting  the  missing  predictor  value  may  be 
/'  generated  from  the  output  information.  This  operation  takes 

very  little  time  on  a  computer  even  when  more  than  one  pre¬ 
dictor  value  is  missing.  MDA  on  the  other  hand  has  to  have 
a  matrix  diagonalization  performed  to  account  for  the  missing 
predictor  or  predictors.  In  addition,  discriminant  functions 
must  be  calculated  for  the  entire  developmental  sample  of  data. 
In  REEP  there  is  obviously  no  difficulty  in  makii^  a  prediction 
when  the  combination  of  predictors  is  not  observed  in  the  de¬ 
velopmental  sample .  However,  in  MDA  the  output  (on  magnetic 
tape)  is  a  table  within  which  all  predictor  combinations 
observed  in  the  developmental  sample  are  given  with  the  cor¬ 
responding  probability  forecasts.  When  a  new  combination  of 
events  arises  probabilities  must  be  determined  usir^  distance 
neighborhood.  The  frequency  of  occurrence  is  about  one  out 
of  every  ten  operational  forecasts.  This  requirement  is  very 
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time  consuming  making  it  much  less  efficient  than  REEP 
in  those  instances. 
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6.0  FUTURE  WORK 


The  most  profitable  single  item  for  future  effort  is  the  modification 
of  the  prediction  model  so  as  to  introduce  some  form  of  nonlinear  capa¬ 
bility.  A  suitable  approach  to  this  problem  has  already  been  suggested 
by  J.  G.  Bryan*  •  The  model  consists  of  a  linear  exponential  function 
which  restricts  the  probability  estimates  to  the  interval  (0,1).  An 
additional  feature  of  this  model  is  that  it  uses  the  present  REEP  selec¬ 
tion  method  to  obtain  a  set  of  selected  predictors  and  the  REEP  procedure 
to  form  a  first  estimate  of  the  required  coefficients.  It  therefore  does 
not  require  an  extended  developmental  period  before  it  can  be  tested. 

Another  area  for  possible  future  work  is  a  study  of  the  selection 
criterion  employed  by  REJP.  The  MDA  criterion  has  been  the  subject  of 
extensive  research.  Several  possible  alternatives  are  available  and 
some  have  been  looked  into  but  none  have  been  subjected  to  a  fair  com¬ 
parison  with  the  present  method. 

A  combination  of  MDA  and  REEP  to  form  a  somewhat  different  forecast 
system  should  also  be  considered.  This  consists  of  applying  the  REEP 
method  to  the  points  enclosed  in  the  Fix-Hodges  neighborhood  used  by 
MDA.  The  purpose  of  this  approach  would  be  to  replace  the  relative 
frequencies,  now  used  as  probabilities  within  the  neighborhood,  by 
thd  REEP  estimates.  While  a  detailed  discussion  of  this  method  cannot 
be  included  here,  it  can  be  reported  that  this  has  been  done  for  some 
selected  cases  with  results  which  are  quite  encouraging. 

*  Bryan,  J.  G.,  1963?  Parametric  estination  of  probabilities  in  multiple 
group  classification.  Unpublished  manuscript.  The  Travelers  Research 
Center,  Inc.,  13  pp. 
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The  natter  of  transforming  continuous  predictors  to  dummy  predic¬ 
tors  needs  further  investigation.  Considerations  include:  means  for 
introducing  as  much  synoptic  and/or  dynamic  information  as  possible 
into  the  dummies;  experimentation  with  different  logical  combinations 
of  the  dummies;  the  effect  of  suppressing  the  vdthin  class  variance 
of  the  continuous  predictors  which  is  an  integral  part  of  the  dummying 
process;  and  the  forcing  of  a  complete  set  of  dummies  onto  the  selection 
program  whenever  one  of  the  sets  is  selected. 

In  the  area  of  application  of  the  technique  many  experiments  re¬ 
main  to  be  carried  out  to  determine  its  characteristics  on  different 
predictands  and  different  data.  The  possibility  of  selecting  a  single 
set  of  predictors  applicable  to  several  predictands  distributed  either 
in  space  or  in  time  has  not  been  thoroughly  explored.  Several  more 
parameters  remain  to  be  tested  for  both  prediction  and  specification. 
Attempts  to  make  predictions  of  continuous  variables  by  increasing 
the  number  of  predictand  groups  is  also  worth  investigating.  In 
sunmary,  a  great  deal  of  work  remains  to  be  done  in  the  application 
area* 
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